00000001:02000400:2.0F:1783137602.222403:0:2967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1783137626.380105:0:3190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1783137627.656499:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 463 MB/s 00000001:01000000:3.0F:1783137627.905812:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 543 MB/s 00000001:01000000:0.0:1783137628.155622:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6583 MB/s 00000020:02000000:1.0:1783137629.076064:0:3283:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gca256e9 00000400:02000000:3.0:1783137629.902309:0:3298:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.124@tcp [8/256/0/180] 00008000:02000000:1.0:1783137633.170789:0:3447:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1783137690.604760:0:5264:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783137700.232206:0:5793:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783137700.232214:0:5793:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783137700.232615:0:5793:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000c4762789 00000080:02000400:0.0:1783137700.232632:0:5793:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1783137700.244634:0:5793:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1783137700.244656:0:5793:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783137700.244713:0:5793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000067c2e988) 00000020:00000080:0.0:1783137700.244742:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783137700.317795:0:5793:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783137700.318352:0:5793:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783137700.352380:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783137700.353106:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783137700.353151:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783137700.353211:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783137700.353274:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783137700.354316:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783137700.354327:0:5793:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783137700.354341:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6ccb 00000020:01000004:2.0:1783137700.354352:0:5793:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783137700.354358:0:5793:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783137700.354363:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c4762789 from MGS 00000020:01000004:2.0:1783137700.354368:0:5793:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783137700.354395:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000061705e8b) 00000020:00000080:2.0:1783137700.354414:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783137700.354780:0:5793:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c4762789 from MGS, refs=2 00080000:01000000:2.0:1783137700.354901:0:5793:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783137700.354913:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6cd9 00000100:00100000:2.0:1783137700.355401:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783137700.355931:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783137700.355940:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783137700.356669:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783137700.356677:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783137700.357524:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137700.357764:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783137700.357770:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783137700.358266:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783137700.358274:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783137700.358801:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783137700.358809:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783137700.359976:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137700.359982:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137700.359984:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137700.360595:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137700.360598:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137700.360599:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137700.361451:0:5793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783137700.366905:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783137700.610720:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2075 MB/s 00000001:01000000:3.0:1783137700.862764:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1777 MB/s 00000001:01000000:3.0:1783137701.116095:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 545 MB/s 00010000:00010000:0.0:1783137701.371104:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1783137701.371810:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 613 MB/s 00080000:10000000:1.0:1783137701.380631:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1783137701.405685:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783137701.405703:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137701.405706:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783137701.411491:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783137701.411614:0:5793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783137701.411664:0:5793:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1783137701.411914:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783137701.411943:0:5793:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783137701.412269:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137701.412420:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783137701.412426:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783137701.413218:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783137701.413226:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783137701.414902:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783137701.414913:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783137701.417412:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783137701.417430:0:5793:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.124@tcp' 00000020:01000004:3.0:1783137701.417432:0:5793:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783137701.417469:0:5793:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.124@tcp (typ=mgc) 00000020:00000080:3.0:1783137701.417485:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.124@tcp (0000000088856482) 00000020:00000080:3.0:1783137701.417499:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783137701.417652:0:5793:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e3c882cd@MGC192.168.202.124@tcp: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1783137701.417816:0:5793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.124@tcp-0 is initialized 00000040:01000000:3.0:1783137701.417822:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 1 is initialized 00000100:00080000:2.0:1783137701.418333:0:5808:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783137701.420861:0:5809:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783137701.421218:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.124@tcp (uuid 83444777-5c31-482f-a1f5-fb6cbc8d0848) 00000020:00000080:3.0:1783137701.421242:0:5793:0:(genops.c:1406:class_connect()) connect: client 83444777-5c31-482f-a1f5-fb6cbc8d0848, cookie 0x4691dfc3d66b6ce7 00000100:00080000:3.0:1783137701.421256:0:5793:0:(import.c:512:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783137701.421262:0:5793:0:(import.c:626:import_select_connection()) MGC192.168.202.124@tcp: import 00000000e3c882cd using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783137701.421304:0:5793:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bc40465e x1869755322466432/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783137701.421398:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bc40465e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83444777-5c31-482f-a1f5-fb6cbc8d0848:3313:1869755322466432:0@lo:250: 00000100:00100000:2.0:1783137701.421495:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783137701.421584:0:5793:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 83444777-5c31-482f-a1f5-fb6cbc8d0848->MGS 00000020:01000004:3.0:1783137701.421611:0:5793:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783137701.421634:0:5793:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783137701.421646:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c231f1be) 00000020:00000080:3.0:1783137701.421659:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783137701.440238:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322466432 00000100:00100000:2.0:1783137701.440253:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322466432 00000100:00100000:2.0:1783137701.440305:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137701.440311:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2bad0df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1869755322466432:12345-0@lo:250: 00010000:00080000:2.0:1783137701.440336:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 83444777-5c31-482f-a1f5-fb6cbc8d0848@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1783137701.440361:0:5805:0:(genops.c:1406:class_connect()) connect: client 83444777-5c31-482f-a1f5-fb6cbc8d0848, cookie 0x4691dfc3d66b6cf5 00000100:00080000:2.0:1783137701.440484:0:5805:0:(import.c:65:import_set_state_nolock()) 0000000071095313 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137701.440582:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2bad0df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:3313:x1869755322466432:12345-0@lo:250: Request processed in 270us (19088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137701.440590:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137701.440629:0:3313:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783137701.440638:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.124@tcp: connect to target with instance 0 00000100:00080000:2.0:1783137701.440644:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783137701.440648:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783137701.440651:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000e3c882cd MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783137701.440654:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783137701.440660:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783137701.440664:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bc40465e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83444777-5c31-482f-a1f5-fb6cbc8d0848:3313:1869755322466432:0@lo:250: 00000100:00100000:3.0:1783137701.451290:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137701.451490:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783137701.451498:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783137701.453167:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783137701.453183:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783137701.453698:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783137701.453705:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783137701.455846:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137701.456024:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783137701.456030:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783137701.457290:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783137701.457300:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783137701.520677:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137701.520907:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783137701.520920:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783137701.525775:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783137701.525874:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783137701.526923:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137701.530242:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783137701.530250:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783137701.532242:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783137701.532257:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783137701.533441:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137701.543793:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783137701.543811:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783137701.548100:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137701.548124:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783137701.549397:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137701.549835:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783137701.549848:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783137701.553461:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783137701.553476:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783137701.587400:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137701.587703:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783137701.587711:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783137701.593349:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783137701.593371:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783137701.594778:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783137701.594789:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783137701.596243:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783137701.596265:0:5793:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783137701.596270:0:5793:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783137701.596389:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783137701.596420:0:5793:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783137701.596424:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783137701.596426:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137701.596427:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137701.596429:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137701.596430:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137701.596432:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137701.596433:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137701.596434:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137701.596436:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137701.596437:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137701.596438:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137701.596439:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137701.596441:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783137701.596443:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783137701.596444:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137701.596445:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137701.596446:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137701.596447:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137701.596448:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137701.596449:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137701.596450:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137701.596450:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137701.596451:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137701.596452:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137701.596453:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137701.596487:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783137701.596503:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f200df2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466560:0@lo:253: 00000100:00100000:2.0:1783137701.596604:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137701.596652:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 000000006dd43630 going to sleep for 11 seconds 00000100:00100000:1.0:1783137701.596723:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322466560 00000100:00100000:1.0:1783137701.596730:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322466560 00000100:00100000:1.0:1783137701.596778:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137701.596785:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003594e156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:5793:x1869755322466560:12345-0@lo:253: 20000000:01000000:1.0:1783137701.596826:0:5807:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783137701.596829:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783137701.597193:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783137701.597243:0:5807:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783137701.597534:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137701.598461:0:5828:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783137701.598732:0:5807:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783137701.598735:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783137701.598740:0:5807:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783137701.598743:0:5807:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783137701.598755:0:5807:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783137701.598940:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137701.599177:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783137701.599189:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783137701.599237:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783137701.599293:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783137701.599330:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783137701.599413:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783137701.599420:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783137701.599463:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783137701.599470:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783137701.599500:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783137701.599507:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783137701.599537:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783137701.599631:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783137701.599662:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783137701.599666:0:5807:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783137701.599679:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137701.599890:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783137701.599899:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783137701.599935:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783137701.599969:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783137701.600026:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783137701.600037:0:5807:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783137701.600105:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783137701.600113:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783137701.600153:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783137701.600207:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783137701.600240:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783137701.600249:0:5807:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783137701.600328:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783137701.600335:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783137701.600365:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783137701.600399:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783137701.600542:0:5807:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783137701.600611:0:5807:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783137701.600618:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783137701.602008:0:5829:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1783137701.602364:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1783137701.602388:0:5807:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.124@tcp for mdt 20000000:01000000:2.0:1783137701.602390:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:2.0:1783137701.602421:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1783137701.602426:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783137701.602442:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1783137701.602446:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:2.0:1783137701.602469:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1783137701.602476:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1783137701.602491:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1783137701.602508:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1783137701.602733:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783137701.602736:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783137701.602740:0:5807:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783137701.602746:0:5807:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783137701.603166:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1783137701.603274:0:5807:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1783137701.608848:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1783137701.608914:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1783137701.609265:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1783137701.609284:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783137701.609286:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783137701.609290:0:5807:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783137701.609301:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137701.609304:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783137701.609334:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783137701.609337:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783137701.610513:0:5831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783137701.610958:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783137701.611011:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783137701.611045:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1783137701.611053:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783137701.611054:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783137701.611447:0:5832:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1783137701.611635:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1783137701.611673:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1783137701.611727:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1783137701.611738:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783137701.611740:0:5807:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1783137701.611744:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137701.611760:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611772:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611779:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611783:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611791:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611795:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611798:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4e177d5 already unused, calling callback (00000000dda67028) 00010000:00010000:2.0:1783137701.611801:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611805:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611813:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611817:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.611821:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6cfc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137701.611831:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783137701.873183:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003594e156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:5793:x1869755322466560:12345-0@lo:253: Request processed in 276391us (276573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137701.873197:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137701.873343:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f200df2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466560:0@lo:253: 10000000:01000000:2.0:1783137701.873359:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783137701.873361:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137701.873363:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137701.873365:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137701.873366:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783137701.873367:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137701.873382:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137701.873383:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137701.873384:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137701.873386:0:5793:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783137701.873388:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137701.873389:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783137701.873472:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c4762789 from lustre-MDT0000 10000000:01000000:2.0:1783137701.873498:0:5793:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783137701.873500:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783137701.873505:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e5dc5dd19c0 10000000:01000000:2.0:1783137701.873509:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137701.873516:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5dc5dd19c0 from 1 10000000:01000000:2.0:1783137701.873518:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783137701.874159:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.874172:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.874182:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137701.874203:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f200df2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466688:0@lo:101: 00000100:00100000:3.0:1783137701.874269:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137701.874367:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000189fd8a8 going to sleep for 11 seconds 00000100:00100000:2.0:1783137701.874631:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322466688 00000100:00100000:2.0:1783137701.874639:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322466688 00000100:00100000:2.0:1783137701.874796:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137701.874807:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8aab488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:5793:x1869755322466688:12345-0@lo:101: 00010000:00010000:2.0:1783137701.874822:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137701.874836:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d03 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.874863:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.874873:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4e177d5/0x4691dfc3d66b6d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137701.874912:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4e177d5, rc 0) 00000100:00100000:2.0:1783137701.874958:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8aab488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:5793:x1869755322466688:12345-0@lo:101: Request processed in 154us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137701.874964:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137701.875050:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f200df2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466688:0@lo:101: 00010000:00010000:3.0:1783137701.875063:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.875072:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137701.875151:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466816:0@lo:501: 00000100:00100000:3.0:1783137701.875177:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137701.875468:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322466816 00000100:00100000:0.0:1783137701.875473:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322466816 00000100:00100000:0.0:1783137701.875505:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137701.875512:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abec2d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:5793:x1869755322466816:12345-0@lo:501: 00000100:00100000:0.0:1783137701.875795:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abec2d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:5793:x1869755322466816:12345-0@lo:501: Request processed in 283us (617us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137701.875802:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137701.876585:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000189fd8a8 going to sleep for 11 seconds 00000100:00100000:3.0:1783137701.876610:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466816:0@lo:501: 10000000:01000000:3.0:1783137701.876646:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783137701.876661:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.876774:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000f813dc44/0x4691dfc3d66b6d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137701.876783:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5dd09a3000 10000000:01000000:3.0:1783137701.876788:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783137701.876793:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5dd09a3000 10000000:01000000:3.0:1783137701.876796:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783137701.876799:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8e5dd09a3000 from 1 10000000:01000000:3.0:1783137701.876802:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783137701.876830:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.876838:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.876845:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137701.876861:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466944:0@lo:101: 00000100:00100000:3.0:1783137701.876920:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137701.876949:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000189fd8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1783137701.877067:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322466944 00000100:00100000:1.0:1783137701.877073:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322466944 00000100:00100000:1.0:1783137701.877119:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137701.877125:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ce28a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:5793:x1869755322466944:12345-0@lo:101: 00010000:00010000:1.0:1783137701.877142:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137701.877155:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051ea11b9/0x4691dfc3d66b6d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d11 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877175:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051ea11b9/0x4691dfc3d66b6d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d11 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877182:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051ea11b9/0x4691dfc3d66b6d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d11 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877189:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051ea11b9, rc 0) 00000100:00100000:1.0:1783137701.877220:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ce28a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+7:5793:x1869755322466944:12345-0@lo:101: Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137701.877226:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137701.877358:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322466944:0@lo:101: 00010000:00010000:3.0:1783137701.877369:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.877376:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137701.877388:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783137701.877391:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.877464:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000c31eaf52/0x4691dfc3d66b6d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137701.877470:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783137701.877474:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783137701.877479:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5dd09a3000 10000000:01000000:3.0:1783137701.877481:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783137701.877484:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783137701.877485:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783137701.877499:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.877506:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.877512:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137701.877530:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467072:0@lo:101: 00000100:00100000:3.0:1783137701.877593:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137701.877607:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000189fd8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1783137701.877774:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467072 00000100:00100000:1.0:1783137701.877779:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467072 00000100:00100000:1.0:1783137701.877811:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137701.877817:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081c6146a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+7:5793:x1869755322467072:12345-0@lo:101: 00010000:00010000:1.0:1783137701.877824:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137701.877831:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cd21b1c/0x4691dfc3d66b6d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d1f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877844:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cd21b1c/0x4691dfc3d66b6d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877851:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cd21b1c/0x4691dfc3d66b6d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137701.877857:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cd21b1c, rc 0) 00000100:00100000:1.0:1783137701.877902:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081c6146a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+8:5793:x1869755322467072:12345-0@lo:101: Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137701.877908:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137701.878164:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467072:0@lo:101: 00010000:00010000:3.0:1783137701.878175:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137701.878182:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137701.878230:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467200:0@lo:501: 00000100:00100000:3.0:1783137701.878255:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137701.878282:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000189fd8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1783137701.878333:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467200 00000100:00100000:1.0:1783137701.878337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467200 00000100:00100000:1.0:1783137701.878366:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137701.878372:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000912e70e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+8:5793:x1869755322467200:12345-0@lo:501: 00000100:00100000:0.0:1783137701.878958:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000912e70e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5793:x1869755322467200:12345-0@lo:501: Request processed in 585us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137701.878965:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137701.879173:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd9cab9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467200:0@lo:501: 00000100:00100000:1.0:1783137701.879231:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467328:0@lo:503: 00000100:00100000:1.0:1783137701.879270:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137701.879301:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 000000009147b294 going to sleep for 11 seconds 00000100:00100000:3.0:1783137701.879364:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467328 00000100:00100000:3.0:1783137701.879368:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467328 00000100:00100000:3.0:1783137701.879457:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137701.879467:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002325d8d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5793:x1869755322467328:12345-0@lo:503: 00000100:00100000:3.0:1783137701.879652:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002325d8d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5793:x1869755322467328:12345-0@lo:503: Request processed in 187us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137701.879658:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137701.879896:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467328:0@lo:503: 00000100:00100000:0.0:1783137701.881066:0:5834:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005cfb7e32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5834:1869755322467456:0@lo:502: 00000100:00100000:0.0:1783137701.881203:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137701.881288:0:5834:0:(client.c:2701:ptlrpc_set_wait()) set 0000000058bfd2ac going to sleep for 11 seconds 00000100:00100000:2.0:1783137701.881358:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467456 00000100:00100000:2.0:1783137701.881369:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467456 00000100:00100000:3.0:1783137701.881735:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137701.881745:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006959c414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5834:x1869755322467456:12345-0@lo:502: 00000100:00100000:3.0:1783137701.882084:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006959c414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5834:x1869755322467456:12345-0@lo:502: Request processed in 331us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137701.882092:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137701.882335:0:5834:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005cfb7e32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5834:1869755322467456:0@lo:502: 00000020:01000000:1.0:1783137701.882364:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137701.882374:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137701.882377:0:5834:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783137701.882382:0:5834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783137701.882384:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137701.882474:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f1ae125a) 00000020:00000080:1.0:1783137701.882494:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783137701.882502:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783137701.882779:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783137701.882787:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6d34 00000020:00000080:1.0:1783137701.883187:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783137701.883192:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137701.883196:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137701.883198:0:5834:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783137701.883201:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137701.883211:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137701.883213:0:5834:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783137701.883218:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137701.883225:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009b3cd457) 00000020:00000080:1.0:1783137701.883237:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783137701.883241:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783137701.883243:0:5834:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783137701.883245:0:5834:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783137701.883251:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783137701.883293:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c4762789 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783137701.883305:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002550f2c5) 00000020:00000080:1.0:1783137701.883313:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783137701.883376:0:5834:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783137701.883382:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b6d49 00000020:00000080:1.0:1783137701.883743:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783137701.883750:0:5834:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783137701.883754:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4691dfc3d66b6d50 00080000:01000000:1.0:1783137701.883759:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783137701.883763:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6d57 00080000:10000000:1.0:1783137701.884311:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1783137701.885312:0:5834:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783137701.896345:0:5834:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783137702.018336:0:5834:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783137702.019324:0:5834:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1783137702.032122:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1783137702.032676:0:5834:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783137702.101866:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008fc7adac) 00000020:00000080:2.0:1783137702.101901:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783137702.101971:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783137702.101977:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6d65 00000020:00000080:3.0:1783137702.110837:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783137702.112128:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783137702.143391:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137702.164527:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.190168:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.220118:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.254180:0:5834:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1783137702.284783:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4691dfc3d66b6d6c 00000020:00000080:1.0:1783137702.285203:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783137702.285214:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137702.285220:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137702.285223:0:5834:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783137702.285226:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137702.285232:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137702.285233:0:5834:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783137702.285236:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783137702.285269:0:5834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783137702.285281:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137702.285290:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137702.285291:0:5834:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783137702.285294:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137702.285296:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137702.285297:0:5834:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783137702.285300:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783137702.285302:0:5834:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783137702.285340:0:5834:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5834:1869755322467584:0@lo:502: 00000100:00100000:1.0:1783137702.285412:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.285471:0:5834:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.285572:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467584 00000100:00100000:3.0:1783137702.285579:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467584 00000100:00100000:3.0:1783137702.285659:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137702.285678:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de6a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5834:x1869755322467584:12345-0@lo:502: 00000100:00100000:3.0:1783137702.285993:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de6a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5834:x1869755322467584:12345-0@lo:502: Request processed in 316us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.286001:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783137702.286091:0:5834:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5834:1869755322467584:0@lo:502: 00000020:01000000:1.0:1783137702.286120:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137702.286124:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137702.286126:0:5834:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137702.286129:0:5834:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783137702.286246:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783137702.286266:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783137702.286280:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.286290:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000885783a8/0x4691dfc3d66b6d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137702.286297:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5dd09a3000 from 1 10000000:01000000:1.0:1783137702.286300:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783137702.286328:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.286334:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.286351:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.286364:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467712:0@lo:101: 00000100:00100000:1.0:1783137702.286391:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.286935:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:0.0:1783137702.287071:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467712 00000100:00100000:0.0:1783137702.287078:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467712 00000100:00100000:0.0:1783137702.287105:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137702.287111:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007906702e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:5793:x1869755322467712:12345-0@lo:101: 00010000:00010000:0.0:1783137702.287122:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.287136:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d73 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287157:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287166:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287174:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cccc562, rc 0) 00000100:00100000:0.0:1783137702.287224:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007906702e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:5793:x1869755322467712:12345-0@lo:101: Request processed in 113us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.287230:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137702.287304:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467712:0@lo:101: 00010000:00010000:1.0:1783137702.287317:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.287325:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.288098:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467840:0@lo:256: 00000100:00100000:1.0:1783137702.288140:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.288161:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:0.0:1783137702.288221:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467840 00000100:00100000:0.0:1783137702.288226:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467840 00000100:00100000:0.0:1783137702.288248:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137702.288253:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002110fdc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:5793:x1869755322467840:12345-0@lo:256: 20000000:01000000:0.0:1783137702.288267:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783137702.288272:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783137702.288334:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002110fdc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:5793:x1869755322467840:12345-0@lo:256: Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.288340:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783137702.288458:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467840:0@lo:256: 10000000:01000000:1.0:1783137702.289248:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783137702.289269:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.289279:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137702.289287:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd09a3000 from 1 10000000:01000000:1.0:1783137702.289289:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137702.289322:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.289328:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.289336:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.289348:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467968:0@lo:101: 00000100:00100000:1.0:1783137702.289386:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.289511:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:2.0:1783137702.289736:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322467968 00000100:00100000:2.0:1783137702.289742:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322467968 00000100:00100000:3.0:1783137702.289817:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137702.289826:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a5aa5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:5793:x1869755322467968:12345-0@lo:101: 00010000:00010000:3.0:1783137702.289837:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137702.289849:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d81 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.289869:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.289889:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.289897:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4f04da3, rc 0) 00000100:00100000:3.0:1783137702.289942:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a5aa5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322467968:12345-0@lo:101: Request processed in 119us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.289948:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137702.290073:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322467968:0@lo:101: 00010000:00010000:1.0:1783137702.290084:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.290091:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.290143:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468096:0@lo:501: 00000100:00100000:1.0:1783137702.290166:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.290195:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.290244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468096 00000100:00100000:3.0:1783137702.290256:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468096 00000100:00100000:3.0:1783137702.290286:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137702.290300:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8615b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322468096:12345-0@lo:501: 00000100:00100000:3.0:1783137702.291817:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8615b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322468096:12345-0@lo:501: Request processed in 1514us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.291828:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137702.292989:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468096:0@lo:501: 00000100:00100000:1.0:1783137702.293178:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468224:0@lo:503: 00000100:00100000:1.0:1783137702.293238:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.293278:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b3dd8abb going to sleep for 11 seconds 00000100:00100000:0.0:1783137702.293344:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468224 00000100:00100000:0.0:1783137702.293350:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468224 00000100:00100000:0.0:1783137702.293395:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137702.293402:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004875b667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322468224:12345-0@lo:503: 00000040:00080000:0.0:1783137702.293446:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137702.293499:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004875b667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322468224:12345-0@lo:503: Request processed in 97us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.293506:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783137702.293740:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468224:0@lo:503: 00000040:00080000:1.0:1783137702.295292:0:5838:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783137702.295960:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783137702.295982:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137702.296002:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.296082:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137702.296198:0:5793:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783137702.296201:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5dd09a3000 10000000:01000000:2.0:1783137702.296204:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5dd09a3000 10000000:01000000:2.0:1783137702.296208:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137702.296214:0:5793:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dd09a3000 from 1 10000000:01000000:2.0:1783137702.296217:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783137702.296252:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.296260:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.296269:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.296305:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468352:0@lo:101: 00000100:00100000:2.0:1783137702.296688:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.296727:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac2a2414 going to sleep for 11 seconds 00000100:00100000:0.0:1783137702.296755:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468352 00000100:00100000:0.0:1783137702.296763:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468352 00000100:00100000:0.0:1783137702.296812:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137702.296820:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f6df76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322468352:12345-0@lo:101: 00010000:00010000:0.0:1783137702.296833:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.296844:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080a4747d/0x4691dfc3d66b6d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6d8f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.296866:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080a4747d/0x4691dfc3d66b6d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.296892:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080a4747d/0x4691dfc3d66b6d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.296900:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080a4747d, rc 0) 00000100:00100000:0.0:1783137702.296952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f6df76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322468352:12345-0@lo:101: Request processed in 133us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.296959:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783137702.297250:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468352:0@lo:101: 00010000:00010000:2.0:1783137702.297265:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.297272:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.297323:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468480:0@lo:501: 00000100:00100000:2.0:1783137702.297347:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.297368:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac2a2414 going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.298766:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468480 00000100:00100000:3.0:1783137702.298777:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468480 00000100:00100000:3.0:1783137702.298829:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137702.298838:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055087cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322468480:12345-0@lo:501: 00000100:00100000:3.0:1783137702.299188:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055087cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322468480:12345-0@lo:501: Request processed in 352us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.299196:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783137702.299234:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468480:0@lo:501: 00000100:00100000:2.0:1783137702.299274:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468608:0@lo:503: 00000100:00100000:2.0:1783137702.299316:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137702.299364:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468608 00000100:00100000:0.0:1783137702.299368:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468608 00000100:00100000:0.0:1783137702.299401:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137702.299407:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bace5f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322468608:12345-0@lo:503: 00000100:00100000:2.0:1783137702.299764:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac2a2414 going to sleep for 11 seconds 00000100:00100000:0.0:1783137702.299890:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bace5f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322468608:12345-0@lo:503: Request processed in 482us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.299897:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137702.299918:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f8bd535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322468608:0@lo:503: 00000100:00100000:1.0:1783137702.300378:0:5839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5839:1869755322468736:0@lo:502: 00000100:00100000:1.0:1783137702.300483:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.300656:0:5839:0:(client.c:2701:ptlrpc_set_wait()) set 00000000da478b60 going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.300918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468736 00000100:00100000:3.0:1783137702.300923:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468736 00000100:00100000:3.0:1783137702.300962:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137702.300970:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ee2745f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5839:x1869755322468736:12345-0@lo:502: 00000100:00100000:3.0:1783137702.301218:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ee2745f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5839:x1869755322468736:12345-0@lo:502: Request processed in 249us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.301224:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137702.301775:0:5839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5839:1869755322468736:0@lo:502: 00000020:01000004:1.0:1783137702.301842:0:5839:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783137702.301857:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000944eb55e) 00000020:00000080:1.0:1783137702.301887:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783137702.302112:0:5839:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c4762789 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783137702.302116:0:5839:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c4762789 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783137702.302119:0:5839:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000c4762789 4 00010000:00080000:1.0:1783137702.302146:0:5839:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae301995@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1783137702.309311:0:5839:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783137702.309429:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783137702.309468:0:5839:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783137702.309492:0:5839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4691dfc3d66b6da4 00000100:00080000:1.0:1783137702.309503:0:5839:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137702.309508:0:5839:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae301995 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783137702.309540:0:5839:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026ffb02d x1869755322468864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783137702.309600:0:5839:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783137702.309950:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322468864:0@lo:38: 00000100:00100000:2.0:1783137702.310023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137702.310480:0:5839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000076f49572 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5839:1869755322468992:0@lo:502: 00000100:00100000:3.0:1783137702.310531:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137702.310571:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468992 00000100:00100000:3.0:1783137702.310578:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468992 00000100:00100000:3.0:1783137702.310620:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137702.310628:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000143108e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5839:x1869755322468992:12345-0@lo:502: 00000100:00100000:3.0:1783137702.311058:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000143108e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5839:x1869755322468992:12345-0@lo:502: Request processed in 430us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.311072:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137702.311123:0:5839:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e9ea9a32 going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.311142:0:5839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000076f49572 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:5839:1869755322468992:0@lo:502: 00000040:00080000:3.0:1783137702.311169:0:5839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783137702.311284:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783137702.311306:0:5793:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783137702.311330:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.311351:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 0000000087b67d0b/0x4691dfc3d66b6d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783137702.311394:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783137702.311396:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137702.311398:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137702.311399:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137702.311400:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137702.311402:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137702.311403:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137702.311405:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137702.311406:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137702.311407:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137702.311409:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137702.311410:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783137702.311414:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783137702.311416:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783137702.311417:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137702.311419:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137702.311419:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137702.311420:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137702.311421:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137702.311422:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137702.311423:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137702.311424:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137702.311425:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137702.311426:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137702.311427:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783137702.311443:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783137702.311452:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8e7099d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322469120:0@lo:253: 00000100:00100000:2.0:1783137702.311485:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.311504:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set 0000000022912e62 going to sleep for 11 seconds 00000100:00100000:2.0:1783137702.311519:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469120 00000100:00100000:2.0:1783137702.311523:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469120 00000100:00100000:2.0:1783137702.311574:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783137702.311586:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8383b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5793:x1869755322469120:12345-0@lo:253: 20000000:01000000:2.0:1783137702.311607:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783137702.311620:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783137702.312326:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322468864 00000100:00100000:1.0:1783137702.312332:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322468864 00000100:00100000:1.0:1783137702.312364:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137702.312369:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f8bd535 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322468864:12345-0@lo:38: 00000100:00100000:1.0:1783137702.312435:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f8bd535 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322468864:12345-0@lo:38: Request processed in 64us (2412us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783137702.312442:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137702.312463:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783137702.312470:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000ae301995 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783137702.312474:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783137702.312477:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000026ffb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322468864:0@lo:38: 20000000:01000000:2.0:1783137702.348107:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783137702.348124:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783137702.350107:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783137702.350130:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783137702.350151:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.350170:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.350179:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.350221:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.350236:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 12 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.350250:0:5827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000a7669ac pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322469248:0@lo:104: 00000100:00100000:1.0:1783137702.350314:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137702.350424:0:5827:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ea06fb00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137702.350964:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469248 00000100:00100000:2.0:1783137702.351092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469248 00000100:00100000:2.0:1783137702.351145:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137702.351154:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd95b5e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322469248:12345-0@lo:104: 00010000:00010000:2.0:1783137702.351168:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.351230:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137702.351235:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd95b5e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322469248:12345-0@lo:104: Request processed in 83us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.351241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783137702.351300:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137702.351306:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.351314:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f50c6e2e already unused, calling callback (000000002c90880e) 10000000:00010000:0.0:1783137702.351317:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.351324:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137702.351330:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137702.351346:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137702.351385:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.351403:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137702.351421:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.351427:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000f50c6e2e/0x4691dfc3d66b6d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d7a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.351444:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137702.351446:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137702.351447:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137702.351578:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004b7bd7be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322469376:0@lo:103: 00000100:00100000:0.0:1783137702.351613:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137702.351919:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469376 00000100:00100000:0.0:1783137702.351924:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469376 00010000:00010000:0.0:1783137702.351942:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 13 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137702.351965:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137702.351984:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000493a94f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3315:x1869755322469376:12345-0@lo:103: 00010000:00010000:0.0:1783137702.351995:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137702.351999:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 13 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352008:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 13 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352030:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352037:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783137702.352051:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001922242s 00010000:00010000:0.0:1783137702.352054:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352060:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352066:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352071:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352076:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e97e8cb already unused, calling callback (00000000dda67028) 00010000:00010000:0.0:1783137702.352079:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352085:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352092:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352100:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137702.352128:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000493a94f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3315:x1869755322469376:12345-0@lo:103: Request processed in 157us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.352140:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137702.352178:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004b7bd7be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322469376:0@lo:103: 00010000:00010000:0.0:1783137702.352214:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6d73 expref: 12 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137702.352224:0:5827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000a7669ac pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322469248:0@lo:104: 00010000:00010000:0.0:1783137702.352235:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352242:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352247:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.352252:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e97e8cb/0x4691dfc3d66b6dab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137702.357349:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8383b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5793:x1869755322469120:12345-0@lo:253: Request processed in 45756us (45857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.357370:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783137702.357841:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8e7099d pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:5793:1869755322469120:0@lo:253: 10000000:01000000:2.0:1783137702.357855:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783137702.357858:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137702.357860:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137702.357862:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137702.357863:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137702.357864:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137702.357865:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137702.357866:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137702.357889:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137702.357890:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137702.357891:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137702.357893:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137702.357894:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783137702.357908:0:5793:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783137702.369361:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.370349:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137702.371089:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.371228:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137702.371374:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.371656:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137702.372263:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.372446:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137702.372916:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.373083:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137702.373206:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137702.373321:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:1.0:1783137702.394945:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1783137702.417253:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1783137702.457354:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783137702.457955:0:5844:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1783137702.457961:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783137702.458087:0:5845:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783137702.461812:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783137702.462084:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783137702.462836:0:5793:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783137702.462847:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783137702.463030:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137702.464744:0:5793:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783137702.466133:0:5793:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783137702.466173:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783137702.466540:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783137702.466776:0:5793:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1783137702.468329:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783137702.468952:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783137702.469192:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783137702.469379:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783137702.469734:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783137702.469924:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783137702.470071:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783137702.470212:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783137702.470352:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783137702.470717:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783137702.470888:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783137702.471122:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783137702.471246:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783137702.471378:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783137702.471628:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783137702.471841:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783137702.472240:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783137702.472654:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783137702.472901:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783137702.473144:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783137702.473277:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783137702.474038:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783137702.474189:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783137702.474354:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783137702.474694:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783137702.474894:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783137702.475133:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783137702.475280:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783137702.475430:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783137702.475611:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783137702.475900:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783137702.476126:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783137702.476319:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783137702.519928:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1783137702.577614:0:5793:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783137702.577653:0:5793:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab14c1c8b988 00100000:10000000:2.0:1783137702.577661:0:5793:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783137702.577885:0:5793:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783137702.577900:0:5793:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783137702.577914:0:5793:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783137702.577941:0:5793:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1783137702.626912:0:5845:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783137702.627048:0:5845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783137702.627052:0:5845:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1783137703.421479:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137704.448192:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137705.466772:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137706.494418:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137707.514713:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783137707.530077:0:6088:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1783137707.706657:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783137707.706821:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5dd09a3000 from 3 10000000:01000000:2.0:1783137707.706826:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137707.706885:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137707.706897:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137707.706909:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137707.706933:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a8e7099d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322469504:0@lo:101: 00000100:00100000:2.0:1783137707.707010:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137707.707111:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 00000000353be051 going to sleep for 11 seconds 00000100:00100000:0.0:1783137707.707193:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469504 00000100:00100000:0.0:1783137707.707212:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469504 00000100:00100000:0.0:1783137707.707299:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137707.707307:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fded93c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5809:x1869755322469504:12345-0@lo:101: 00010000:00010000:0.0:1783137707.707332:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137707.707343:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab80f372/0x4691dfc3d66b6db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6db2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137707.707365:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab80f372/0x4691dfc3d66b6db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137707.707375:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab80f372/0x4691dfc3d66b6db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137707.707384:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab80f372, rc 0) 00000100:00100000:0.0:1783137707.707430:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fded93c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322469504:12345-0@lo:101: Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.707436:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783137707.707507:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a8e7099d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322469504:0@lo:101: 00010000:00010000:3.0:1783137707.707521:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137707.707530:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783137707.707603:0:1386:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783137707.707615:0:1386:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783137707.707618:0:1386:0:(import.c:65:import_set_state_nolock()) 00000000ae301995 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783137707.707623:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000076f49572 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322469632:0@lo:256: 00000100:00080000:2.0:1783137707.707641:0:1386:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae301995 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783137707.707655:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137707.707661:0:1386:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d682b280 x1869755322469760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783137707.707675:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 00000000622a1de8 going to sleep for 11 seconds 00000100:00100000:3.0:1783137707.707899:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d682b280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322469760:0@lo:38: 00000100:00100000:3.0:1783137707.707988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137707.708038:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469760 00000100:00100000:3.0:1783137707.708044:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469760 00000100:00100000:3.0:1783137707.708066:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137707.708070:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080fae4dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869755322469760:12345-0@lo:38: 00010000:00080000:3.0:1783137707.708090:0:5813:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000100:00100000:0.0:1783137707.708111:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469632 00000100:00100000:0.0:1783137707.708115:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469632 00000020:00000080:3.0:1783137707.708124:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4691dfc3d66b6dc0 00000100:00100000:0.0:1783137707.708135:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137707.708140:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c579cbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322469632:12345-0@lo:256: 20000000:01000000:0.0:1783137707.708153:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783137707.708168:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783137707.708171:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000004:00100000:3.0:1783137707.708182:0:5813:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783137707.708241:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c579cbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322469632:12345-0@lo:256: Request processed in 100us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.708248:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783137707.708303:0:5813:0:(import.c:65:import_set_state_nolock()) 00000000f3f20e19 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137707.708339:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080fae4dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869755322469760:12345-0@lo:38: Request processed in 267us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.708687:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000076f49572 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322469632:0@lo:256: 10000000:01000000:0.0:1783137707.708736:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783137707.708746:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137707.708755:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: 00000000483316de/0x4691dfc3d66b6db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137707.709460:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783137707.709513:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d682b280 x1869755322469760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783137707.709529:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783137707.709539:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783137707.709557:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783137707.709560:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000ae301995 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783137707.709567:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d682b280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322469760:0@lo:38: 00010000:00010000:2.0:1783137708.538784:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137709.570319:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137710.589248:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137711.611817:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137712.634803:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137712.829709:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003448cb2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322469888:0@lo:400: 00000100:00100000:0.0:1783137712.829794:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137712.829849:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137712.829855:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c25a69d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322470016:0@lo:400: 00000100:00100000:0.0:1783137712.829923:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137712.829990:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322469888 00000100:00100000:0.0:1783137712.829997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322469888 00000100:00100000:0.0:1783137712.830243:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137712.830252:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f33df1ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3316:x1869755322469888:12345-0@lo:400: 00000100:00100000:0.0:1783137712.830295:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f33df1ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3316:x1869755322469888:12345-0@lo:400: Request processed in 46us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137712.830303:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137712.830336:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470016 00000100:00100000:0.0:1783137712.830339:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470016 00000100:00100000:0.0:1783137712.830366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137712.830371:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b7bd7be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322470016:12345-0@lo:400: 00000100:00100000:0.0:1783137712.830411:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b7bd7be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322470016:12345-0@lo:400: Request processed in 40us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137712.830417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783137712.830449:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c25a69d6 x1869755322470016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137712.830478:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c25a69d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322470016:0@lo:400: 00000100:00100000:0.0:1783137712.830489:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003448cb2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322469888:0@lo:400: 00000020:00000080:3.0:1783137713.474966:0:6291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff90ec4b50 20000000:00000080:3.0:1783137713.474984:0:6291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5dc602d000 uarg=0000000000000000 20000000:01000000:3.0:1783137713.475019:0:6291:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783137713.475026:0:6291:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783137713.475030:0:6291:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783137713.475219:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1783137713.475232:0:6291:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1783137713.483733:0:6291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137713.484048:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783137713.484109:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1783137713.484163:0:6291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1783137713.484183:0:6291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783137713.484201:0:6291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.484220:0:6291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.484229:0:6291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.484277:0:6291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.484293:0:6291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137713.484306:0:6291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000076bec61c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6291:1869755322470144:0@lo:104: 00000100:00100000:3.0:1783137713.484366:0:6291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137713.484425:0:6291:0:(client.c:2701:ptlrpc_set_wait()) set 00000000508666b6 going to sleep for 11 seconds 00000100:00100000:2.0:1783137713.484505:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470144 00000100:00100000:2.0:1783137713.484514:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470144 00000100:00100000:2.0:1783137713.484593:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137713.484602:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed67b7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:6291:x1869755322470144:12345-0@lo:104: 00010000:00010000:2.0:1783137713.484614:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137713.484669:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137713.484674:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed67b7ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:6291:x1869755322470144:12345-0@lo:104: Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137713.484682:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783137713.484810:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137713.484816:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.484831:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e36ad277 already unused, calling callback (000000002c90880e) 10000000:00010000:1.0:1783137713.484834:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.484842:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137713.484848:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137713.484853:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137713.484884:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.484890:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137713.484905:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.484911:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: 00000000e36ad277/0x4691dfc3d66b6d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d88 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.484927:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137713.484929:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137713.484930:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137713.484979:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008a415957 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322470272:0@lo:103: 00000100:00100000:0.0:1783137713.485013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137713.485099:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470272 00000100:00100000:1.0:1783137713.485104:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470272 00010000:00010000:1.0:1783137713.485122:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 12 pid: 5806 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137713.485152:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137713.485165:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a1413f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3314:x1869755322470272:12345-0@lo:103: 00010000:00010000:1.0:1783137713.485175:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137713.485180:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 12 pid: 5806 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485190:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 12 pid: 5806 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485205:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485212:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485225:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485230:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485235:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485241:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485245:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038412ad0 already unused, calling callback (00000000dda67028) 00010000:00010000:1.0:1783137713.485248:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485254:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485268:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.485277:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137713.485305:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a1413f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3314:x1869755322470272:12345-0@lo:103: Request processed in 142us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137713.485311:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783137713.485381:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008a415957 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322470272:0@lo:103: 00010000:00010000:3.0:1783137713.491001:0:6291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4f04da3/0x4691dfc3d66b6d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6d81 expref: 11 pid: 5806 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137713.491021:0:6291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000076bec61c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6291:1869755322470144:0@lo:104: 00010000:00010000:3.0:1783137713.491044:0:6291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.491053:0:6291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.491059:0:6291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137713.491082:0:6291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038412ad0/0x4691dfc3d66b6dc7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137713.659737:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137714.687078:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137715.706847:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137715.970649:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137715.970658:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd09a3000 from 1 10000000:01000000:2.0:1783137715.970662:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137715.970837:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: 0000000002124bbb/0x4691dfc3d66b6dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137715.970853:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: 0000000002124bbb/0x4691dfc3d66b6dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137715.970865:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: 0000000002124bbb/0x4691dfc3d66b6dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137715.970908:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470400:0@lo:101: 00000100:00100000:2.0:1783137715.970976:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137715.971067:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055e64ec5 going to sleep for 11 seconds 00000100:00100000:0.0:1783137715.976511:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470400 00000100:00100000:0.0:1783137715.976526:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470400 00000100:00100000:0.0:1783137715.976608:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783137715.976619:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041b87ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:5809:x1869755322470400:12345-0@lo:101: 00010000:00010000:0.0:1783137715.976642:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137715.976663:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6dce expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137715.976840:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137715.976853:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cccc562/0x4691dfc3d66b6dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137715.976863:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cccc562, rc 0) 00000100:00100000:0.0:1783137715.976970:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041b87ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322470400:12345-0@lo:101: Request processed in 352us (5994us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137715.976978:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783137715.977116:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470400:0@lo:101: 00010000:00010000:2.0:1783137715.977137:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: 0000000002124bbb/0x4691dfc3d66b6dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137715.977145:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: 0000000002124bbb/0x4691dfc3d66b6dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137715.977219:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470528:0@lo:501: 00000100:00100000:2.0:1783137715.977255:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137715.977284:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055e64ec5 going to sleep for 11 seconds 00000100:00100000:0.0:1783137715.977454:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470528 00000100:00100000:0.0:1783137715.977459:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470528 00000100:00100000:0.0:1783137715.977490:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137715.977510:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025d298ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322470528:12345-0@lo:501: 00000100:00100000:0.0:1783137715.978817:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025d298ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322470528:12345-0@lo:501: Request processed in 1303us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137715.978829:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137715.979004:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470528:0@lo:501: 00000100:00100000:2.0:1783137715.979050:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470656:0@lo:503: 00000100:00100000:2.0:1783137715.979138:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137715.979173:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055e64ec5 going to sleep for 11 seconds 00000100:00100000:0.0:1783137715.979219:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470656 00000100:00100000:0.0:1783137715.979224:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470656 00000100:00100000:0.0:1783137715.979264:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137715.979271:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed1875b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322470656:12345-0@lo:503: 00000100:00100000:0.0:1783137715.980372:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed1875b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322470656:12345-0@lo:503: Request processed in 1097us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137715.980383:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137715.988091:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322470656:0@lo:503: 00000100:00100000:2.0:1783137715.988439:0:6363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6363:1869755322470784:0@lo:502: 00000100:00100000:2.0:1783137715.988509:0:6363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137715.988569:0:6363:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cab8b73b going to sleep for 11 seconds 00000100:00100000:0.0:1783137715.995604:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470784 00000100:00100000:0.0:1783137715.995621:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470784 00000100:00100000:0.0:1783137715.996865:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137715.996887:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000995e46fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6363:x1869755322470784:12345-0@lo:502: 00000100:00100000:0.0:1783137715.997139:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000995e46fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6363:x1869755322470784:12345-0@lo:502: Request processed in 262us (8630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137716.003225:0:6363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005b67bb15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6363:1869755322470784:0@lo:502: 00000020:01000000:2.0:1783137716.003281:0:6363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137716.003294:0:6363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137716.003308:0:6363:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783137716.003314:0:6363:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dd09a3000 00000020:00000080:2.0:1783137716.003317:0:6363:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783137716.005086:0:6363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6363:1869755322470912:0@lo:502: 00000100:00100000:2.0:1783137716.005176:0:6363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137716.005279:0:6363:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137716.005845:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137716.005920:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322470912 00000100:00100000:0.0:1783137716.005927:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322470912 00000100:00100000:3.0:1783137716.010529:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783137716.018005:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6363:x1869755322470912:12345-0@lo:502: 00000100:00100000:3.0:1783137716.018293:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6363:x1869755322470912:12345-0@lo:502: Request processed in 7749us (13114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137716.018308:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137716.018569:0:6363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6363:1869755322470912:0@lo:502: 00000020:01000000:2.0:1783137716.018603:0:6363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137716.018611:0:6363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137716.018613:0:6363:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783137716.018617:0:6363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783137716.018684:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783137716.018699:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137716.018710:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137716.018720:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137716.738574:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137717.756340:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137717.960306:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137717.960332:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322471040:0@lo:400: 00000100:00100000:1.0:1783137717.960401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137717.960454:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322471168:0@lo:400: 00000100:00100000:1.0:1783137717.960483:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137717.960517:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471040 00000100:00100000:1.0:1783137717.960524:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471040 00000100:00100000:1.0:1783137717.960590:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137717.960600:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3314:x1869755322471040:12345-0@lo:400: 00000100:00100000:1.0:1783137717.960648:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3314:x1869755322471040:12345-0@lo:400: Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137717.960654:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137717.960684:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471168 00000100:00100000:1.0:1783137717.960688:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471168 00000100:00100000:1.0:1783137717.960713:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137717.960719:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322471168:12345-0@lo:400: 00000100:00100000:1.0:1783137717.960781:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322471168:12345-0@lo:400: Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137717.960788:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137717.960817:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322471040:0@lo:400: 00010000:00080000:1.0:1783137717.960848:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df5f7c000 x1869755322471168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137717.960859:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322471168:0@lo:400: 00010000:00010000:1.0:1783137718.778863:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137719.803244:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783137719.808063:0:6612:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783137719.808067:0:6612:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783137719.808201:0:6612:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e5dc5ce5000 00000020:01000004:3.0:1783137719.808218:0:6612:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783137719.808229:0:6612:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783137719.808242:0:6612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e5dc5dd0000) 00000020:00000080:3.0:1783137719.808257:0:6612:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783137719.832294:0:6612:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1783137719.832613:0:6612:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1783137719.859580:0:6612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783137719.875742:0:6612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783137719.875778:0:6612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783137719.876765:0:6612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783137719.876811:0:6612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783137719.877478:0:6612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783137719.877489:0:6612:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783137719.877501:0:6612:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4691dfc3d66b6de3 00000020:01000004:2.0:1783137719.877509:0:6612:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783137719.877530:0:6612:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783137719.877567:0:6612:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783137719.877574:0:6612:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783137719.877580:0:6612:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783137719.877591:0:6612:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e5dc7eccd40) 00000020:00000080:2.0:1783137719.877601:0:6612:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783137719.883360:0:6612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137719.883562:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783137719.883568:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783137719.886316:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783137719.886326:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783137719.887385:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783137719.887393:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783137719.893377:0:6612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137719.894739:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783137719.894750:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783137719.901114:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783137719.904717:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783137719.933180:0:6612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137719.933418:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783137719.933424:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783137719.935759:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783137719.935772:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783137719.937662:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783137719.937674:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783137719.945525:0:6612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137719.947416:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783137719.947426:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783137719.950382:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783137719.950396:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783137720.042253:0:6612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137720.042449:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783137720.042456:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783137720.047295:0:6612:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783137720.047308:0:6612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783137720.048055:0:6612:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783137720.048081:0:6612:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783137720.048087:0:6612:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783137720.076761:0:6612:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783137720.076801:0:6612:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1783137720.076806:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783137720.076808:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137720.076809:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137720.076810:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137720.076812:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137720.076816:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137720.076818:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137720.076820:0:6612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137720.076821:0:6612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137720.076823:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137720.076893:0:6612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137720.076898:0:6612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1783137720.076901:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137720.076902:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137720.076903:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137720.076904:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137720.076905:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137720.076906:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137720.076907:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137720.076907:0:6612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137720.076908:0:6612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137720.076909:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137720.076910:0:6612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137720.076938:0:6612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783137720.076958:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322471296:0@lo:253: 00000100:00100000:1.0:1783137720.077086:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137720.077211:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.077764:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471296 00000100:00100000:2.0:1783137720.077773:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471296 00000100:00100000:2.0:1783137720.077913:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137720.077923:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322471296:12345-0@lo:253: 20000000:01000000:2.0:1783137720.077957:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783137720.077961:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783137720.077966:0:5805:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783137720.077969:0:5805:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783137720.079246:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137720.079459:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1783137720.079921:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783137720.079972:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1783137720.079982:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783137720.080026:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1783137720.080082:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1783137720.080498:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1783137720.080525:0:5805:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:2.0:1783137720.080528:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:2.0:1783137720.080588:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1783137720.080598:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783137720.080647:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1783137720.080655:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:2.0:1783137720.080684:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1783137720.080691:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783137720.080721:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1783137720.080785:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1783137720.082438:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1783137720.082465:0:5805:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:2.0:1783137720.082468:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:2.0:1783137720.082797:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1783137720.082806:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783137720.083706:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1783137720.083722:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:2.0:1783137720.083810:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1783137720.083820:0:5805:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783137720.083949:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1783137720.084062:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1783137720.084082:0:5805:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1783137720.084085:0:5805:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1783137720.084091:0:5805:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783137720.084092:0:5805:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783137720.084094:0:5805:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783137720.084106:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137720.084109:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783137720.084147:0:5805:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783137720.084150:0:5805:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783137720.087372:0:6627:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783137720.087459:0:6627:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783137720.088893:0:6627:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1783137720.089460:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1783137720.089525:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1783137720.089604:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1783137720.089618:0:5805:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783137720.089620:0:5805:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783137720.090359:0:6628:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783137720.090638:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1783137720.090682:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1783137720.090776:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1783137720.090789:0:5805:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783137720.090792:0:5805:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783137720.092143:0:6629:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1783137720.092214:0:6629:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1783137720.092280:0:6629:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783137720.092649:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783137720.092689:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783137720.092777:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1783137720.092797:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137720.092818:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093110:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093119:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093126:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093133:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093175:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093190:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 12 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.093216:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471424:0@lo:104: 00000100:00100000:2.0:1783137720.093283:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.093412:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471424 00000100:00100000:0.0:1783137720.093419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471424 00000100:00100000:0.0:1783137720.093482:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137720.093492:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471424:12345-0@lo:104: 00010000:00010000:0.0:1783137720.093504:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093572:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137720.093579:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471424:12345-0@lo:104: Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.093587:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783137720.093663:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.093672:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 12 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.093679:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471552:0@lo:104: 00000100:00100000:2.0:1783137720.093701:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.093755:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471552 00000100:00100000:0.0:1783137720.093759:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471552 00000100:00100000:0.0:1783137720.093775:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137720.093781:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471552:12345-0@lo:104: 00010000:00010000:0.0:1783137720.093788:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093840:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783137720.093846:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471552:12345-0@lo:104: Request processed in 65us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.093851:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783137720.093868:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137720.093873:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093881:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137720.093885:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093901:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137720.093908:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137720.093912:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137720.093940:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093946:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137720.093964:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093970:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b6d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d96 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.093982:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137720.093997:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.094003:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137720.094005:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.094010:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137720.094016:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137720.094027:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137720.094041:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.094047:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137720.094062:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.094068:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9000/0x4691dfc3d66b6d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.094078:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.094080:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.094081:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137720.094102:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322471680:0@lo:103: 00000100:00100000:0.0:1783137720.094130:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137720.094996:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137720.095180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137720.095196:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322471808:0@lo:103: 00000100:00100000:1.0:1783137720.095239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137720.096056:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.096070:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 12 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.096082:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471936:0@lo:104: 00000100:00100000:2.0:1783137720.096115:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.096183:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e011049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.096203:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471424:0@lo:104: 00000100:00100000:2.0:1783137720.096212:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471552:0@lo:104: 00000100:00100000:0.0:1783137720.096301:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471680 00000100:00100000:0.0:1783137720.096307:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471680 00010000:00010000:0.0:1783137720.096332:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 13 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.096470:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471808 00000100:00100000:0.0:1783137720.096483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471808 00010000:00010000:0.0:1783137720.096496:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 14 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137720.096522:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322471936 00000100:00100000:3.0:1783137720.096526:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322471936 00000100:00100000:3.0:1783137720.096580:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137720.096589:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471936:12345-0@lo:104: 00010000:00010000:3.0:1783137720.096601:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.096649:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137720.096655:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5805:x1869755322471936:12345-0@lo:104: Request processed in 68us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.096661:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137720.096960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137720.096968:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3317:x1869755322471680:12345-0@lo:103: 00010000:00010000:2.0:1783137720.096978:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137720.096993:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 14 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.097020:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 14 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.097034:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6d8f expref: 14 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.097048:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137720.097139:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783137720.097147:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783137720.097164:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783137720.097173:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137720.097186:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3315:x1869755322471808:12345-0@lo:103: 00010000:00010000:0.0:1783137720.097194:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137720.097198:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 13 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097207:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 13 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097216:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4400/0x4691dfc3d66b6d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6d1f expref: 13 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097224:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137720.097254:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3315:x1869755322471808:12345-0@lo:103: Request processed in 69us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.097260:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137720.097288:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322471808:0@lo:103: 00010000:00010000:0.0:1783137720.097307:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137720.097312:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097319:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d8a00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137720.097323:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097330:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137720.097336:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137720.097366:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137720.097393:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097400:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137720.097415:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097422:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6d0a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.097437:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.097439:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.097440:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137720.097453:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137720.097463:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322472064:0@lo:103: 00000100:00100000:2.0:1783137720.097673:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:3317:x1869755322471680:12345-0@lo:103: Request processed in 705us (3540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.097680:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137720.097711:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5805:1869755322471936:0@lo:104: 00010000:00010000:2.0:1783137720.097740:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.097862:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.098016:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472064 00000100:00100000:0.0:1783137720.098021:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472064 00010000:00010000:0.0:1783137720.098038:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 11 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.098057:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137720.098063:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:3314:x1869755322472064:12345-0@lo:103: 00010000:00010000:0.0:1783137720.098071:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137720.098075:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 11 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098082:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 11 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098101:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b6d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6d03 expref: 11 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098115:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098122:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098134:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098140:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098147:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098153:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098158:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137720.098163:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098170:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098181:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.098198:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137720.098224:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:3314:x1869755322472064:12345-0@lo:103: Request processed in 162us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.098230:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137720.098254:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322472064:0@lo:103: 00010000:00010000:2.0:1783137720.098762:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.098771:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.098776:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02044c00/0x4691dfc3d66b6df1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137720.098792:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783137720.099830:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322471680:0@lo:103: 00000100:00100000:3.0:1783137720.180859:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:6612:x1869755322471296:12345-0@lo:253: Request processed in 102929us (103764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.180874:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137720.181022:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322471296:0@lo:253: 10000000:01000000:1.0:1783137720.181038:0:6612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783137720.181042:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137720.181043:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137720.181045:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137720.181047:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1783137720.181048:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137720.181049:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137720.181064:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137720.181066:0:6612:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783137720.181067:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137720.181068:0:6612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783137720.181087:0:6612:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5dc5ce5000 from lustre-OST0000 10000000:01000000:1.0:1783137720.181112:0:6612:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783137720.181115:0:6612:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783137720.181122:0:6612:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5dc5dd19c0 local copy 10000000:01000000:1.0:1783137720.181126:0:6612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137720.181162:0:6612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137720.181173:0:6612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137720.181182:0:6612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137720.181200:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472192:0@lo:101: 00000100:00100000:1.0:1783137720.181235:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137720.181301:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.181364:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472192 00000100:00100000:0.0:1783137720.181370:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472192 00000100:00100000:0.0:1783137720.181413:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783137720.181423:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:6612:x1869755322472192:12345-0@lo:101: 00010000:00010000:0.0:1783137720.181436:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137720.181449:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030600/0x4691dfc3d66b6dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6df8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.181472:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030600/0x4691dfc3d66b6dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6df8 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.181481:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030600/0x4691dfc3d66b6dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6df8 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.181490:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137720.181525:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:6612:x1869755322472192:12345-0@lo:101: Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.181530:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137720.181631:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472192:0@lo:101: 00010000:00010000:2.0:1783137720.181643:0:6612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.181651:0:6612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.181761:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472320:0@lo:501: 00000100:00100000:2.0:1783137720.181787:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.181804:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137720.181921:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472320 00000100:00100000:3.0:1783137720.181930:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472320 00000100:00100000:3.0:1783137720.181962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783137720.181968:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:6612:x1869755322472320:12345-0@lo:501: 00000100:00100000:3.0:1783137720.182168:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:6612:x1869755322472320:12345-0@lo:501: Request processed in 199us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137720.182175:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137720.182297:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472320:0@lo:501: 10000000:01000000:2.0:1783137720.182310:0:6612:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783137720.182335:0:6612:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783137720.182340:0:6612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.182347:0:6612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.182353:0:6612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.182379:0:6612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783137720.182395:0:6612:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5dc5ce5000 10000000:01000000:2.0:1783137720.182400:0:6612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783137720.182404:0:6612:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e5dc5dd19c0 10000000:01000000:2.0:1783137720.182406:0:6612:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783137720.182409:0:6612:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8e5dc5dd19c0 from 1 10000000:01000000:2.0:1783137720.182411:0:6612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783137720.182428:0:6612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.182435:0:6612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.182451:0:6612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.182464:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472448:0@lo:101: 00000100:00100000:2.0:1783137720.182491:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.182514:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00010000:00010000:0.0:1783137720.182575:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137720.182581:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182599:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4e00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137720.182603:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182610:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137720.182617:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137720.182623:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137720.182642:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182648:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137720.182681:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182689:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4e00/0x4691dfc3d66b6df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6dff expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182706:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.182708:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137720.182709:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137720.182717:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137720.182738:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322472576:0@lo:103: 00000100:00100000:0.0:1783137720.182766:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.182800:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472576 00000100:00100000:0.0:1783137720.182804:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472576 00000100:00100000:0.0:1783137720.182856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137720.182863:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:3317:x1869755322472576:12345-0@lo:103: 00010000:00010000:0.0:1783137720.182874:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137720.182886:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030600/0x4691dfc3d66b6dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6df8 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.182899:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137720.182925:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:3317:x1869755322472576:12345-0@lo:103: Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.182931:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137720.182956:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322472576:0@lo:103: 00000100:00100000:1.0:1783137720.183077:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472448 00000100:00100000:1.0:1783137720.183081:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472448 00000100:00100000:1.0:1783137720.183110:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137720.183116:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:6612:x1869755322472448:12345-0@lo:101: 00010000:00010000:1.0:1783137720.183123:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137720.183132:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5a00/0x4691dfc3d66b6e0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e06 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137720.183147:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5a00/0x4691dfc3d66b6e0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e06 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137720.183165:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5a00/0x4691dfc3d66b6e0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e06 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137720.183171:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5a00, rc 0) 00000100:00100000:1.0:1783137720.183196:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:6612:x1869755322472448:12345-0@lo:101: Request processed in 80us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137720.183201:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783137720.183520:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472448:0@lo:101: 00010000:00010000:2.0:1783137720.183533:0:6612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.183541:0:6612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137720.183595:0:6612:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783137720.183602:0:6612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.183609:0:6612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137720.183615:0:6612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783137720.183619:0:6612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137720.183624:0:6612:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783137720.183626:0:6612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783137720.183639:0:6612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.183646:0:6612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.183659:0:6612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.183670:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472704:0@lo:101: 00000100:00100000:2.0:1783137720.183696:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.183723:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137720.183785:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472704 00000100:00100000:3.0:1783137720.183789:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472704 00000100:00100000:3.0:1783137720.183819:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783137720.183833:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+10:6612:x1869755322472704:12345-0@lo:101: 00010000:00010000:3.0:1783137720.183839:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137720.183848:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e14 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.183860:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.183867:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.183874:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9400, rc 0) 00000100:00100000:3.0:1783137720.183898:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322472704:12345-0@lo:101: Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.183903:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783137720.184118:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472704:0@lo:101: 00010000:00010000:2.0:1783137720.184128:0:6612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.184134:0:6612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.184202:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472832:0@lo:501: 00000100:00100000:2.0:1783137720.184225:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.184246:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137720.184292:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472832 00000100:00100000:1.0:1783137720.184295:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472832 00000100:00100000:1.0:1783137720.184321:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783137720.184327:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322472832:12345-0@lo:501: 00000100:00100000:1.0:1783137720.184541:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322472832:12345-0@lo:501: Request processed in 214us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137720.184571:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783137720.184793:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472832:0@lo:501: 00000100:00100000:2.0:1783137720.184821:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472960:0@lo:503: 00000100:00100000:2.0:1783137720.184870:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.184900:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.185002:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322472960 00000100:00100000:0.0:1783137720.185007:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322472960 00000100:00100000:0.0:1783137720.185039:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783137720.185046:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322472960:12345-0@lo:503: 00000100:00100000:0.0:1783137720.185205:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322472960:12345-0@lo:503: Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.185211:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783137720.185385:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322472960:0@lo:503: 00000040:00080000:2.0:1783137720.185698:0:6612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783137720.185778:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473088:0@lo:502: 00000100:00100000:2.0:1783137720.185814:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137720.189226:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.189781:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473088 00000100:00100000:0.0:1783137720.189794:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473088 00000100:00100000:3.0:1783137720.190054:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783137720.190065:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322473088:12345-0@lo:502: 00000100:00100000:3.0:1783137720.190403:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322473088:12345-0@lo:502: Request processed in 338us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.190418:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783137720.190743:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473088:0@lo:502: 00000040:00080000:2.0:1783137720.191186:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783137720.191248:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783137720.191286:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783137720.191336:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783137720.191492:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783137720.191530:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783137720.191602:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473216:0@lo:502: 00000100:00100000:2.0:1783137720.191663:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.191767:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc8760a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137720.191819:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473216 00000100:00100000:1.0:1783137720.191890:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473216 00000100:00100000:1.0:1783137720.191986:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783137720.191996:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322473216:12345-0@lo:502: 00000100:00100000:1.0:1783137720.192210:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322473216:12345-0@lo:502: Request processed in 215us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137720.192217:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783137720.192306:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473216:0@lo:502: 00000040:00080000:2.0:1783137720.192500:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783137720.192511:0:6612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1783137720.193284:0:6631:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137720.193293:0:6631:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783137720.193299:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137720.193301:0:6631:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783137720.193305:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137720.193319:0:6631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e5dc7ec8000) 00000020:00000080:2.0:1783137720.193339:0:6631:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783137720.193344:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783137720.193660:0:6631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dc5ce5000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783137720.193668:0:6631:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783137720.193674:0:6631:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4691dfc3d66b6e29 00010000:00010000:3.0:1783137720.198819:0:6631:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1783137720.199212:0:6631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1783137720.208372:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783137720.208709:0:6631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783137720.215072:0:6631:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783137720.221313:0:6631:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783137720.225159:0:6631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783137720.225173:0:6631:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137720.225181:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137720.225183:0:6631:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783137720.225187:0:6631:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137720.225199:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137720.225200:0:6631:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783137720.225204:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783137720.225205:0:6631:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783137720.225263:0:6631:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137720.225267:0:6631:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137720.225269:0:6631:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137720.225272:0:6631:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783137720.230187:0:6612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783137720.230231:0:6612:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783137720.230311:0:6612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.230325:0:6612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137720.230334:0:6612:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5ce5000 from 1 10000000:01000000:3.0:1783137720.230337:0:6612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137720.230392:0:6612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.230401:0:6612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.230412:0:6612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137720.230434:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473344:0@lo:101: 00000100:00100000:3.0:1783137720.230507:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137720.230650:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.232651:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473344 00000100:00100000:2.0:1783137720.232666:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473344 00000100:00100000:2.0:1783137720.232742:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783137720.232753:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:6612:x1869755322473344:12345-0@lo:101: 00010000:00010000:2.0:1783137720.232773:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137720.232790:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e30 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.233022:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.233035:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.233045:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044e00, rc 0) 00000100:00100000:2.0:1783137720.233114:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473344:12345-0@lo:101: Request processed in 362us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.233120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783137720.234305:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473344:0@lo:101: 00010000:00010000:2.0:1783137720.234330:0:6612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.234341:0:6612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.234471:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473472:0@lo:501: 00000100:00100000:2.0:1783137720.234519:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.234568:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc87600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137720.234977:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473472 00000100:00100000:1.0:1783137720.234984:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473472 00000100:00100000:1.0:1783137720.235028:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783137720.235038:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473472:12345-0@lo:501: 00000100:00100000:1.0:1783137720.235265:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473472:12345-0@lo:501: Request processed in 228us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137720.235273:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783137720.235721:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473472:0@lo:501: 00000100:00100000:2.0:1783137720.235776:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473600:0@lo:503: 00000100:00100000:2.0:1783137720.235832:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.235856:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc87600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.235874:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473600 00000100:00100000:2.0:1783137720.235878:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473600 00000100:00100000:2.0:1783137720.235915:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783137720.235922:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473600:12345-0@lo:503: 00000100:00100000:2.0:1783137720.236169:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473600:12345-0@lo:503: Request processed in 247us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.236175:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783137720.236212:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473600:0@lo:503: 00000040:00080000:2.0:1783137720.236472:0:6612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783137720.236532:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473728:0@lo:502: 00000100:00100000:2.0:1783137720.236593:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.236608:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc87600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.236623:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473728 00000100:00100000:2.0:1783137720.236627:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473728 00000100:00100000:2.0:1783137720.236646:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783137720.236652:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473728:12345-0@lo:502: 00000100:00100000:2.0:1783137720.236811:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473728:12345-0@lo:502: Request processed in 158us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.244884:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783137720.245015:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473728:0@lo:502: 00000040:00080000:2.0:1783137720.245346:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783137720.245411:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783137720.245450:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473856:0@lo:502: 00000100:00100000:2.0:1783137720.245517:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137720.245578:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc87600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.246625:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473856 00000100:00100000:0.0:1783137720.246635:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473856 00000100:00100000:0.0:1783137720.246693:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137720.246703:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473856:12345-0@lo:502: 00000100:00100000:0.0:1783137720.246965:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473856:12345-0@lo:502: Request processed in 263us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.246972:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783137720.252027:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473856:0@lo:502: 00000040:00080000:2.0:1783137720.252230:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783137720.252246:0:6612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783137720.253262:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137720.253273:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137720.253276:0:6635:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783137720.253282:0:6635:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dc5ce5000 00000020:00000080:2.0:1783137720.253285:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137720.253303:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137720.253306:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137720.253307:0:6635:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783137720.253310:0:6635:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783137720.253424:0:6612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783137720.253443:0:6612:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137720.253468:0:6612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.253479:0:6612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137720.253520:0:6612:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783137720.253524:0:6612:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5dc5ce5000 10000000:01000000:0.0:1783137720.253526:0:6612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5dc5ce5000 10000000:01000000:0.0:1783137720.253530:0:6612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137720.253535:0:6612:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dc5ce5000 from 1 10000000:01000000:0.0:1783137720.253538:0:6612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137720.253592:0:6612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.253602:0:6612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.253612:0:6612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.253634:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473984:0@lo:101: 00000100:00100000:0.0:1783137720.253702:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.253757:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.254958:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322473984 00000100:00100000:2.0:1783137720.254970:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322473984 00000100:00100000:2.0:1783137720.255025:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783137720.255036:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322473984:12345-0@lo:101: 00010000:00010000:2.0:1783137720.255051:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137720.255066:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e3e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.255090:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.255099:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137720.255107:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045800, rc 0) 00000100:00100000:2.0:1783137720.255164:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322473984:12345-0@lo:101: Request processed in 130us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.255169:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783137720.255448:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322473984:0@lo:101: 00010000:00010000:0.0:1783137720.255467:0:6612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.255488:0:6612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.255640:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474112:0@lo:501: 00000100:00100000:0.0:1783137720.255674:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.255705:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.256317:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474112 00000100:00100000:2.0:1783137720.256323:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474112 00000100:00100000:2.0:1783137720.256376:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783137720.256384:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474112:12345-0@lo:501: 00000100:00100000:2.0:1783137720.256672:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474112:12345-0@lo:501: Request processed in 287us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.256679:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783137720.256779:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474112:0@lo:501: 00000100:00100000:1.0:1783137720.256834:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474240:0@lo:503: 00000100:00100000:1.0:1783137720.256876:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137720.256903:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.257018:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474240 00000100:00100000:0.0:1783137720.257023:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474240 00000100:00100000:0.0:1783137720.257057:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783137720.257064:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474240:12345-0@lo:503: 00000100:00100000:0.0:1783137720.257205:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474240:12345-0@lo:503: Request processed in 141us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.257212:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783137720.257373:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474240:0@lo:503: 00000040:00080000:1.0:1783137720.257654:0:6612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137720.257717:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474368:0@lo:502: 00000100:00100000:1.0:1783137720.257767:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137720.257787:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137720.258034:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474368 00000100:00100000:0.0:1783137720.258039:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474368 00000100:00100000:0.0:1783137720.258072:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137720.258079:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474368:12345-0@lo:502: 00000100:00100000:0.0:1783137720.258241:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474368:12345-0@lo:502: Request processed in 162us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137720.258247:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783137720.258348:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474368:0@lo:502: 00000040:00080000:1.0:1783137720.258893:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783137720.258946:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783137720.258983:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783137720.259041:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783137720.259078:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783137720.259129:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783137720.259166:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783137720.259202:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783137720.259264:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783137720.259302:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783137720.259338:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783137720.259412:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783137720.259446:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783137720.259472:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783137720.259517:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783137720.259584:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783137720.259621:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783137720.259669:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783137720.259704:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783137720.259748:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783137720.259796:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783137720.259845:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783137720.259879:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783137720.259927:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783137720.259963:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783137720.259999:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783137720.260046:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783137720.260083:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1783137720.260123:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474496:0@lo:502: 00000100:00100000:1.0:1783137720.260187:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137720.260230:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137720.264183:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474496 00000100:00100000:2.0:1783137720.264202:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474496 00000100:00100000:2.0:1783137720.264287:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783137720.264299:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474496:12345-0@lo:502: 00000100:00100000:2.0:1783137720.264971:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474496:12345-0@lo:502: Request processed in 672us (4782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.264980:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783137720.265790:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474496:0@lo:502: 00000040:00080000:0.0:1783137720.266031:0:6612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783137720.266048:0:6612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783137720.267007:0:6636:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783137720.267022:0:6636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e5dc7ef3380) 00000020:00000080:0.0:1783137720.267044:0:6636:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1783137720.267246:0:6636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dc5ce5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783137720.267251:0:6636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dc5ce5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783137720.267254:0:6636:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5ce5000 3 00010000:00080000:0.0:1783137720.267285:0:6636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dffbcc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1783137720.269951:0:6636:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1783137720.270078:0:6636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783137720.270122:0:6636:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783137720.270137:0:6636:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4691dfc3d66b6e53 00000100:00080000:1.0:1783137720.270154:0:6636:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137720.270160:0:6636:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5dffbcc000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783137720.270196:0:6636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5f7ce00 x1869755322474624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783137720.270223:0:6636:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783137720.270308:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322474752:0@lo:400: 00000100:00100000:1.0:1783137720.270381:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137720.271091:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322474624:0@lo:38: 00000100:00100000:3.0:1783137720.271141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137720.271191:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474752 00000100:00100000:3.0:1783137720.271197:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474752 00000100:00100000:3.0:1783137720.271234:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474624 00000100:00100000:3.0:1783137720.271237:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474624 00000100:00100000:3.0:1783137720.271251:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137720.271261:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322474752:12345-0@lo:400: 00000100:00100000:3.0:1783137720.271311:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322474752:12345-0@lo:400: Request processed in 51us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.271318:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137720.271334:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137720.271338:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869755322474624:12345-0@lo:38: 00010000:00080000:3.0:1783137720.271369:0:5813:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1783137720.271402:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4691dfc3d66b6e5a 00000004:00100000:3.0:1783137720.271416:0:5813:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783137720.271445:0:5813:0:(import.c:65:import_set_state_nolock()) ffff8e5def68d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137720.271480:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869755322474624:12345-0@lo:38: Request processed in 139us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.271486:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783137720.271520:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df5f7ce00 x1869755322474624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137720.271531:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783137720.271537:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783137720.271566:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783137720.271571:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783137720.271573:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783137720.271580:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322474624:0@lo:38: 00010000:00080000:3.0:1783137720.271619:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df5f7d880 x1869755322474752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137720.271630:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322474752:0@lo:400: 00000040:00080000:3.0:1783137720.272128:0:6636:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1783137720.272277:0:6612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1783137720.272303:0:6612:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137720.272326:0:6612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.272337:0:6612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137720.272382:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783137720.272384:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137720.272386:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137720.272387:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137720.272388:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137720.272390:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137720.272391:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137720.272393:0:6612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137720.272394:0:6612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137720.272396:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137720.272397:0:6612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137720.272401:0:6612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783137720.272403:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137720.272405:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137720.272406:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137720.272407:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137720.272408:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137720.272409:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137720.272410:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137720.272412:0:6612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137720.272412:0:6612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137720.272413:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137720.272415:0:6612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137720.272434:0:6612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783137720.272445:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474880:0@lo:253: 00000100:00100000:0.0:1783137720.272490:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.272518:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137720.273615:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322474880 00000100:00100000:3.0:1783137720.273624:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322474880 00000100:00100000:3.0:1783137720.273665:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783137720.273674:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6612:x1869755322474880:12345-0@lo:253: 20000000:01000000:3.0:1783137720.273703:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783137720.273717:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783137720.325033:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783137720.325056:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783137720.326996:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783137720.327005:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783137720.327028:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.327047:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.327055:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.327100:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137720.327114:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 13 pid: 5805 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137720.327129:0:5827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322475008:0@lo:104: 00000100:00100000:0.0:1783137720.327193:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137720.327347:0:5827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88840 going to sleep for 11 seconds 00000100:00100000:3.0:1783137720.327772:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475008 00000100:00100000:3.0:1783137720.327780:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475008 00000100:00100000:3.0:1783137720.327978:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137720.327990:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322475008:12345-0@lo:104: 00010000:00010000:3.0:1783137720.328005:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328079:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137720.328085:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322475008:12345-0@lo:104: Request processed in 99us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.328092:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137720.328162:0:5827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322475008:0@lo:104: 00010000:00010000:1.0:1783137720.328184:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328421:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137720.328427:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328436:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045e00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:3.0:1783137720.328439:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328460:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137720.328468:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137720.328473:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137720.328508:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328515:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137720.328536:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328562:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328580:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137720.328582:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137720.328584:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137720.328599:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322475136:0@lo:103: 00000100:00100000:3.0:1783137720.328634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137720.328685:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475136 00000100:00100000:3.0:1783137720.328690:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475136 00010000:00010000:3.0:1783137720.328707:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 14 pid: 5805 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137720.328744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137720.328751:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3314:x1869755322475136:12345-0@lo:103: 00010000:00010000:3.0:1783137720.328767:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137720.328773:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 14 pid: 5805 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328783:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 14 pid: 5805 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328794:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6db2 expref: 14 pid: 5805 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328807:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328816:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783137720.328839:0:5798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001922242s 00010000:00010000:3.0:1783137720.328843:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328850:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.328856:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329024:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329029:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783137720.329033:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329045:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329060:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329071:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137720.329110:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3314:x1869755322475136:12345-0@lo:103: Request processed in 359us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137720.329117:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783137720.329164:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329173:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137720.329181:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6e61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137720.329257:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322475136:0@lo:103: 00000100:00100000:2.0:1783137720.339885:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:6612:x1869755322474880:12345-0@lo:253: Request processed in 66199us (67381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137720.339902:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783137720.340067:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:6612:1869755322474880:0@lo:253: 10000000:01000000:0.0:1783137720.340082:0:6612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783137720.340085:0:6612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137720.340087:0:6612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137720.340089:0:6612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137720.340090:0:6612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137720.340092:0:6612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137720.340093:0:6612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137720.340094:0:6612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137720.340096:0:6612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137720.340112:0:6612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137720.340114:0:6612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137720.340116:0:6612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137720.340131:0:6612:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783137720.346171:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137720.346344:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137720.346518:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137720.346691:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137720.346954:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137720.347177:0:6612:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783137720.348146:0:6612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783137720.660798:0:6612:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783137720.660806:0:6612:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783137720.660857:0:6612:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783137720.660986:0:6612:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783137720.661005:0:6612:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783137720.661034:0:6612:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1783137720.829598:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137721.853443:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137722.874716:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137723.452609:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783137723.452619:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dd09a3000 from 21 10000000:01000000:2.0:1783137723.452624:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783137723.452682:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137723.452716:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137723.452728:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137723.452752:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475264:0@lo:101: 00000100:00100000:2.0:1783137723.452833:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.452881:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.453500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475264 00000100:00100000:1.0:1783137723.453509:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475264 00000100:00100000:1.0:1783137723.453580:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783137723.453589:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322475264:12345-0@lo:101: 00010000:00010000:1.0:1783137723.453603:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137723.453618:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e68 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.453642:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.453659:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.453680:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5600, rc 0) 00000100:00100000:1.0:1783137723.453749:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475264:12345-0@lo:101: Request processed in 161us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.453755:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783137723.453814:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475264:0@lo:101: 00010000:00010000:1.0:1783137723.453831:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.453841:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137723.453906:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475392:0@lo:501: 00000100:00100000:1.0:1783137723.453933:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.453961:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5423780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.453974:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475392 00000100:00100000:1.0:1783137723.453978:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475392 00000100:00100000:1.0:1783137723.453998:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783137723.454004:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475392:12345-0@lo:501: 00000100:00100000:1.0:1783137723.454348:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475392:12345-0@lo:501: Request processed in 343us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.454355:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783137723.454386:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475392:0@lo:501: 00000100:00100000:1.0:1783137723.454411:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475520:0@lo:503: 00000100:00100000:1.0:1783137723.454454:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.454468:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5423780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.454479:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475520 00000100:00100000:1.0:1783137723.454482:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475520 00000100:00100000:1.0:1783137723.454503:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783137723.454509:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475520:12345-0@lo:503: 00000100:00100000:1.0:1783137723.454817:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475520:12345-0@lo:503: Request processed in 306us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.454824:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783137723.454859:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475520:0@lo:503: 00000100:00100000:1.0:1783137723.455036:0:6758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6758:1869755322475648:0@lo:502: 00000100:00100000:1.0:1783137723.455071:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.455091:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475648 00000100:00100000:1.0:1783137723.455095:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475648 00000100:00100000:1.0:1783137723.455116:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137723.455122:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6758:x1869755322475648:12345-0@lo:502: 00000100:00100000:1.0:1783137723.455299:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6758:x1869755322475648:12345-0@lo:502: Request processed in 176us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.455305:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137723.455335:0:6758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc54233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.455347:0:6758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6758:1869755322475648:0@lo:502: 00000100:00100000:1.0:1783137723.455384:0:6758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6758:1869755322475776:0@lo:502: 00000100:00100000:1.0:1783137723.455414:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.455431:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475776 00000100:00100000:1.0:1783137723.455434:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475776 00000100:00100000:1.0:1783137723.455454:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137723.455466:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6758:x1869755322475776:12345-0@lo:502: 00000100:00100000:1.0:1783137723.455605:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:6758:x1869755322475776:12345-0@lo:502: Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.455611:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137723.455637:0:6758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.455649:0:6758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6758:1869755322475776:0@lo:502: 00000040:00080000:1.0:1783137723.455667:0:6758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783137723.455730:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783137723.455747:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137723.455757:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455767:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137723.455776:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783137723.455779:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5dd09a3000 from 4 10000000:01000000:1.0:1783137723.455782:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783137723.455806:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455814:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455823:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137723.455836:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475904:0@lo:101: 00000100:00100000:1.0:1783137723.455862:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.455883:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5423b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.455895:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322475904 00000100:00100000:1.0:1783137723.455899:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322475904 00000100:00100000:1.0:1783137723.455920:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137723.455926:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322475904:12345-0@lo:101: 00010000:00010000:1.0:1783137723.455935:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137723.455947:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e76 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455967:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455977:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.455986:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5400, rc 0) 00000100:00100000:1.0:1783137723.456012:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322475904:12345-0@lo:101: Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.456018:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137723.456047:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322475904:0@lo:101: 00010000:00010000:1.0:1783137723.456058:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456066:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137723.456106:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476032:0@lo:256: 00000100:00100000:1.0:1783137723.456135:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.456147:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.456163:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476032 00000100:00100000:1.0:1783137723.456166:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476032 00000100:00100000:1.0:1783137723.456187:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137723.456193:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322476032:12345-0@lo:256: 20000000:01000000:1.0:1783137723.456206:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137723.456223:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137723.456226:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1783137723.456303:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322476032:12345-0@lo:256: Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.456311:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137723.456338:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476032:0@lo:256: 10000000:01000000:1.0:1783137723.456375:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783137723.456380:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456387:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137723.456393:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783137723.456395:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783137723.456397:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137723.456411:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456418:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456426:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137723.456447:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476160:0@lo:101: 00000100:00100000:1.0:1783137723.456470:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.456483:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.456494:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476160 00000100:00100000:1.0:1783137723.456497:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476160 00000100:00100000:1.0:1783137723.456516:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137723.456523:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322476160:12345-0@lo:101: 00010000:00010000:1.0:1783137723.456529:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137723.456537:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6e84 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456577:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456584:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456591:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d4e00, rc 0) 00000100:00100000:1.0:1783137723.456617:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322476160:12345-0@lo:101: Request processed in 95us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.456623:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137723.456652:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476160:0@lo:101: 00010000:00010000:1.0:1783137723.456662:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.456669:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137723.463344:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476288:0@lo:501: 00000100:00100000:1.0:1783137723.463420:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.463459:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476288 00000100:00100000:1.0:1783137723.463466:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476288 00000100:00100000:1.0:1783137723.463513:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137723.463523:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322476288:12345-0@lo:501: 00000100:00100000:1.0:1783137723.464516:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322476288:12345-0@lo:501: Request processed in 990us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.464527:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137723.464623:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.464648:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476288:0@lo:501: 00000100:00100000:1.0:1783137723.465386:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476416:0@lo:503: 00000100:00100000:1.0:1783137723.465447:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.465477:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6546d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137723.465649:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476416 00000100:00100000:2.0:1783137723.465655:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476416 00000100:00100000:2.0:1783137723.467859:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137723.467873:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322476416:12345-0@lo:503: 00000100:00100000:2.0:1783137723.468281:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322476416:12345-0@lo:503: Request processed in 410us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137723.468290:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137723.468364:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322476416:0@lo:503: 00000100:00100000:2.0:1783137723.468584:0:6759:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6759:1869755322476544:0@lo:502: 00000100:00100000:2.0:1783137723.468626:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.468657:0:6759:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd84b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137723.471939:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476544 00000100:00100000:0.0:1783137723.471954:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476544 00000100:00100000:0.0:1783137723.472017:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783137723.472027:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:6759:x1869755322476544:12345-0@lo:502: 00000100:00100000:1.0:1783137723.478423:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:6759:x1869755322476544:12345-0@lo:502: Request processed in 6387us (9786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.478439:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783137723.478642:0:6759:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6759:1869755322476544:0@lo:502: 00000020:01000000:2.0:1783137723.478691:0:6759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137723.478709:0:6759:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783137723.478717:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137723.478719:0:6759:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783137723.478725:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783137723.478741:0:6759:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1783137723.478765:0:6759:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783137723.478768:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137723.478797:0:6759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5df5c0cd40) 00000020:00000080:2.0:1783137723.478819:0:6759:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783137723.478825:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783137723.478911:0:6759:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783137723.478917:0:6759:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783137723.478924:0:6759:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6e99 00010000:00080000:2.0:1783137723.478956:0:6759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dd214b800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1783137723.479198:0:6759:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783137723.576948:0:6759:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783137723.576977:0:6759:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783137723.578407:0:6759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137723.578796:0:6759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137723.578845:0:6759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783137723.580357:0:6759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783137723.588489:0:6761:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137723.588497:0:6761:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783137723.591322:0:6759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783137723.591338:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783137723.591374:0:6759:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783137723.591394:0:6759:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b6ea0 00000100:00080000:0.0:1783137723.591404:0:6759:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137723.591421:0:6759:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5dd214b800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137723.591456:0:6759:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5f8aa00 x1869755322476672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783137723.591523:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322476672:0@lo:8: 00000100:00100000:3.0:1783137723.591638:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.591828:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476672 00000100:00100000:2.0:1783137723.591837:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476672 00000100:00100000:2.0:1783137723.591875:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137723.591884:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869755322476672:12345-0@lo:8: 00010000:00080000:2.0:1783137723.591909:0:6615:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1783137723.591944:0:6615:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b6ea7 00002000:00100000:2.0:1783137723.591973:0:6615:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5dffd02000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783137723.591978:0:6615:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1783137723.591981:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783137723.592165:0:6615:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783137723.592297:0:6615:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783137723.592320:0:6615:0:(import.c:65:import_set_state_nolock()) ffff8e5dffd06800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783137723.592586:0:6759:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783137723.592663:0:6759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137723.592668:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137723.592670:0:6759:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783137723.592673:0:6759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137723.592677:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137723.592679:0:6759:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783137723.592682:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783137723.592683:0:6759:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783137723.592724:0:6759:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6759:1869755322476800:0@lo:502: 00000100:00100000:0.0:1783137723.592770:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137723.592791:0:6759:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137723.593086:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137723.593095:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322476928:0@lo:400: 00000100:00100000:1.0:1783137723.593124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137723.593153:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322477056:0@lo:400: 00000100:00100000:1.0:1783137723.593181:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137723.594728:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476928 00000100:00100000:0.0:1783137723.594743:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476928 00000100:00100000:0.0:1783137723.594787:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477056 00000100:00100000:0.0:1783137723.594790:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477056 00000100:00100000:0.0:1783137723.594821:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137723.594829:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322476928:12345-0@lo:400: 00000100:00100000:0.0:1783137723.594901:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322476928:12345-0@lo:400: Request processed in 73us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137723.594908:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137723.594924:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137723.594930:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322477056:12345-0@lo:400: 00000100:00100000:0.0:1783137723.594960:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322477056:12345-0@lo:400: Request processed in 31us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137723.594965:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137723.596305:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869755322476672:12345-0@lo:8: Request processed in 4411us (4657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137723.596316:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137723.596359:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322476800 00000100:00100000:2.0:1783137723.596365:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322476800 00000100:00100000:2.0:1783137723.596405:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783137723.596413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:6759:x1869755322476800:12345-0@lo:502: 00000100:00100000:2.0:1783137723.597000:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:6759:x1869755322476800:12345-0@lo:502: Request processed in 572us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137723.597007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1783137723.597048:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137723.597077:0:6759:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:6759:1869755322476800:0@lo:502: 00000020:01000000:2.0:1783137723.597111:0:6759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137723.597128:0:6759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137723.597131:0:6759:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783137723.597136:0:6759:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1783137723.597258:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783137723.597277:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783137723.597297:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137723.597308:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137723.597317:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783137723.597319:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5dc5dd19c0 from 1 10000000:01000000:2.0:1783137723.597322:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783137723.597352:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137723.597371:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137723.597381:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137723.597399:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322477184:0@lo:101: 00000100:00100000:2.0:1783137723.597434:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.597464:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34299c0 going to sleep for 11 seconds 00010000:00080000:2.0:1783137723.597691:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7f800 x1869755322477056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137723.597715:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322477056:0@lo:400: 00010000:00080000:3.0:1783137723.598274:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f8aa00 x1869755322476672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137723.598350:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783137723.598358:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783137723.598367:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783137723.598372:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783137723.598384:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dd214b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783137723.598413:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783137723.598420:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322476672:0@lo:8: 00010000:00080000:1.0:1783137723.598638:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7df80 x1869755322476928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137723.598660:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322476928:0@lo:400: 00000100:00100000:1.0:1783137723.598695:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477184 00000100:00100000:1.0:1783137723.599101:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477184 00000100:00100000:1.0:1783137723.599150:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783137723.599159:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322477184:12345-0@lo:101: 00010000:00010000:1.0:1783137723.599174:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137723.599190:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6eae expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.599215:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.599225:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137723.599233:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d4a00, rc 0) 00000100:00100000:1.0:1783137723.599296:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322477184:12345-0@lo:101: Request processed in 138us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.599303:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1783137723.599406:0:6761:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783137723.599535:0:6761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213491989383ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783137723.599842:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322477184:0@lo:101: 00010000:00010000:0.0:1783137723.599938:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137723.599949:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137723.600189:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322477312:0@lo:501: 00000100:00100000:0.0:1783137723.600234:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137723.600319:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137723.605641:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477312 00000100:00100000:2.0:1783137723.605658:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477312 00000100:00100000:2.0:1783137723.605723:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783137723.605734:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322477312:12345-0@lo:501: 00000100:00100000:2.0:1783137723.606660:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322477312:12345-0@lo:501: Request processed in 926us (6422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137723.606671:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783137723.606834:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322477312:0@lo:501: 10000000:01000000:0.0:1783137723.606952:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783137723.606963:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137723.606981:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137723.736349:0:6762:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783137723.736470:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322477440:0@lo:13: 00000100:00100000:2.0:1783137723.736582:0:6762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477568:0@lo:7: 00000100:00100000:3.0:1783137723.736583:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.736616:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.736633:0:6762:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137723.736651:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477568 00000100:00100000:2.0:1783137723.736657:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477568 00000100:00100000:2.0:1783137723.736730:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137723.736753:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6762:x1869755322477568:12345-0@lo:7: 00000100:00080000:3.0:1783137723.736781:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137723.737725:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477440 00000100:00100000:1.0:1783137723.737734:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477440 00000100:00100000:1.0:1783137723.737777:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137723.737785:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322477440:12345-0@lo:13: 00002000:00000024:1.0:1783137723.737826:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783137723.737894:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322477440:12345-0@lo:13: Request processed in 108us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137723.737902:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783137723.739459:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5e0110fb80 x1869755322477440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137723.739489:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322477440:0@lo:13: 00002000:00080000:2.0:1783137723.755086:0:6617:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783137723.755097:0:6617:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783137723.755196:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6762:x1869755322477568:12345-0@lo:7: Request processed in 18440us (18574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137723.755624:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783137723.755684:0:6762:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5e0110ed80 x1869755322477568/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783137739 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137723.755712:0:6762:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477568:0@lo:7: 00000004:00080000:2.0:1783137723.755729:0:6762:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783137723.755775:0:6762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477696:0@lo:5: 00000100:00100000:2.0:1783137723.755814:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.755851:0:6762:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137723.755872:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477696 00000100:00100000:2.0:1783137723.755877:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477696 00000100:00100000:2.0:1783137723.755920:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137723.755927:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6762:x1869755322477696:12345-0@lo:5: 00002000:00080000:2.0:1783137723.755951:0:6615:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783137723.755954:0:6615:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783137723.756166:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6762:x1869755322477696:12345-0@lo:5: Request processed in 238us (352us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783137723.756173:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783137723.756215:0:6762:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5e0110ed80 x1869755322477696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137739 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137723.756226:0:6762:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477696:0@lo:5: 00000004:00080000:2.0:1783137723.756235:0:6762:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783137723.756281:0:6762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477824:0@lo:700: 00000100:00100000:2.0:1783137723.756306:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137723.756329:0:6762:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137723.756413:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477824 00000100:00100000:3.0:1783137723.756419:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477824 00000100:00100000:3.0:1783137723.756453:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137723.756460:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6762:x1869755322477824:12345-0@lo:700: 00000100:00100000:3.0:1783137723.756489:0:6623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6623:1869755322477952:0@lo:700: 00000100:00100000:3.0:1783137723.756533:0:6623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137723.756574:0:6623:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137723.756594:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322477952 00000100:00100000:3.0:1783137723.756597:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322477952 00000100:00100000:3.0:1783137723.756626:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137723.756633:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6623:x1869755322477952:12345-0@lo:700: 00000004:00080000:2.0:1783137723.877652:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1783137723.899060:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1783137723.943983:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1783137723.958074:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6623:x1869755322477952:12345-0@lo:700: Request processed in 201429us (201528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137723.958112:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783137723.958513:0:6623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4204000 x1869755322477952/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783137739 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137723.958529:0:6623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6623:1869755322477952:0@lo:700: 40000000:02000000:3.0:1783137723.958589:0:6623:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1783137724.109135:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6762:x1869755322477824:12345-0@lo:700: Request processed in 352665us (352817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137724.109154:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783137724.109214:0:6762:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5e0110c000 x1869755322477824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783137739 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137724.109231:0:6762:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322477824:0@lo:700: 00000001:00080000:1.0:1783137724.109782:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1783137724.109794:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1783137724.190908:0:6762:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1783137724.204479:0:6762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322478080:0@lo:5: 00000100:00100000:3.0:1783137724.204588:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137724.204644:0:6762:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021db40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137724.204719:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478080 00000100:00100000:3.0:1783137724.204727:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478080 00000100:00100000:3.0:1783137724.204783:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137724.204795:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6762:x1869755322478080:12345-0@lo:5: 00002000:00080000:3.0:1783137724.211499:0:6615:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783137724.211521:0:6615:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1783137724.221262:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6762:x1869755322478080:12345-0@lo:5: Request processed in 16463us (16668us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783137724.221281:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783137724.221358:0:6762:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4204000 x1869755322478080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137740 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137724.221372:0:6762:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783137724.221389:0:6762:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5dc4204000 x1869755322478080/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137740 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137724.221401:0:6762:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6762:1869755322478080:0@lo:5: 00000004:00080000:3.0:1783137724.221415:0:6762:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1783137724.924582:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137725.952706:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137726.970875:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137727.994751:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137728.290019:0:6985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783137728.699895:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322478208:0@lo:400: 00000100:00100000:3.0:1783137728.700004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137728.700091:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137728.700099:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322478336:0@lo:400: 00000100:00100000:3.0:1783137728.700135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137728.700181:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322478592:0@lo:400: 00000100:00100000:3.0:1783137728.700212:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137728.700247:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137728.700254:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322478464:0@lo:400: 00000100:00100000:3.0:1783137728.700280:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137728.700312:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478208 00000100:00100000:3.0:1783137728.700336:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478208 00000100:00100000:3.0:1783137728.700395:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783137728.700406:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322478208:12345-0@lo:400: 00000100:00100000:3.0:1783137728.700469:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322478208:12345-0@lo:400: Request processed in 64us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137728.700478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783137728.700519:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478592 00000100:00100000:3.0:1783137728.700523:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478592 00000100:00100000:3.0:1783137728.700605:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137728.700612:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322478592:12345-0@lo:400: 00000100:00100000:3.0:1783137728.700654:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322478592:12345-0@lo:400: Request processed in 42us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137728.700673:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783137728.700693:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783137728.700731:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7f800 x1869755322478592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137728.700748:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322478592:0@lo:400: 00000100:00100000:0.0:1783137728.701122:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478336 00000100:00100000:0.0:1783137728.701129:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478336 00000100:00100000:0.0:1783137728.701170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478464 00000100:00100000:0.0:1783137728.701174:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478464 00000100:00100000:0.0:1783137728.701198:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137728.701205:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322478336:12345-0@lo:400: 00000100:00100000:0.0:1783137728.701268:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322478336:12345-0@lo:400: Request processed in 63us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137728.701275:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137728.701290:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137728.701296:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322478464:12345-0@lo:400: 00010000:00080000:3.0:1783137728.701644:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7d500 x1869755322478464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137728.701668:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322478464:0@lo:400: 00010000:00080000:3.0:1783137728.701720:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7c380 x1869755322478336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137728.701731:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322478336:0@lo:400: 00000100:00100000:3.0:1783137728.701742:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322478208:0@lo:400: 00000100:00100000:0.0:1783137728.701858:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322478464:12345-0@lo:400: Request processed in 562us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137728.701865:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783137728.701895:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137729.022677:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137729.215603:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137729.215645:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322478720:0@lo:13: 00000100:00100000:1.0:1783137729.219726:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137729.219817:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478720 00000100:00100000:1.0:1783137729.219828:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478720 00000100:00100000:1.0:1783137729.219892:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137729.219904:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322478720:12345-0@lo:13: 00002000:00000024:1.0:1783137729.219951:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137729.220005:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322478720:12345-0@lo:13: Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137729.220012:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783137729.220064:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7c700 x1869755322478720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137729.220088:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322478720:0@lo:13: 00000001:00080000:2.0:1783137729.307988:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1783137730.051002:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137731.070890:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137732.097673:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137733.115094:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137733.821910:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322479232:0@lo:400: 00000100:00100000:3.0:1783137733.822010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137733.822099:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137733.822110:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322478848:0@lo:400: 00000100:00100000:3.0:1783137733.822166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137733.822207:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322479104:0@lo:400: 00000100:00100000:3.0:1783137733.822236:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137733.822256:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137733.822262:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322478976:0@lo:400: 00000100:00100000:3.0:1783137733.822282:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137733.825837:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479104 00000100:00100000:0.0:1783137733.826659:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479104 00000100:00100000:0.0:1783137733.826765:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478976 00000100:00100000:0.0:1783137733.826770:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478976 00000100:00100000:0.0:1783137733.826795:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137733.826808:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322479104:12345-0@lo:400: 00000100:00080000:3.0:1783137733.827657:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137733.827678:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783137733.827692:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783137733.828155:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322479104:12345-0@lo:400: Request processed in 1342us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137733.828168:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137733.828376:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137733.828389:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322478976:12345-0@lo:400: 00000100:00100000:0.0:1783137733.828459:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322478976:12345-0@lo:400: Request processed in 75us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137733.828466:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783137733.828534:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4205f80 x1869755322478976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137733.828586:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322478976:0@lo:400: 00010000:00080000:0.0:1783137733.828624:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4206d80 x1869755322479104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137733.828635:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322479104:0@lo:400: 00000100:00100000:1.0:1783137733.829831:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479232 00000100:00100000:1.0:1783137733.829845:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479232 00000100:00100000:1.0:1783137733.829964:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137733.829977:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322479232:12345-0@lo:400: 00000100:00100000:1.0:1783137733.830102:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322479232:12345-0@lo:400: Request processed in 128us (8091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137733.830110:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783137733.830357:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4205500 x1869755322479232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137733.830369:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783137733.830402:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322479232:0@lo:400: 00000100:00100000:2.0:1783137733.830496:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322478848 00000100:00100000:2.0:1783137733.830501:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322478848 00000100:00100000:2.0:1783137733.830541:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783137733.830584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322478848:12345-0@lo:400: 00000100:00100000:2.0:1783137733.830643:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322478848:12345-0@lo:400: Request processed in 61us (8478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137733.830650:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783137733.830691:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322478848:0@lo:400: 00000100:00080000:3.0:1783137733.830998:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783137734.158622:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137734.331981:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137734.332017:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322479360:0@lo:13: 00000100:00100000:3.0:1783137734.332120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137734.334257:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479360 00000100:00100000:2.0:1783137734.334394:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479360 00000100:00100000:3.0:1783137734.335043:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137734.335056:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322479360:12345-0@lo:13: 00002000:00000024:3.0:1783137734.335105:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137734.335206:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322479360:12345-0@lo:13: Request processed in 152us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137734.335213:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783137734.335265:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4204700 x1869755322479360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137734.335300:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322479360:0@lo:13: 00010000:00010000:0.0:1783137735.164990:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137736.191025:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137737.216783:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137738.234768:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137738.941148:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322479872:0@lo:400: 00000100:00100000:1.0:1783137738.941227:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137738.941296:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137738.941303:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322479744:0@lo:400: 00000100:00100000:1.0:1783137738.941346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137738.941385:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479744 00000100:00100000:1.0:1783137738.941393:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479744 00000100:00100000:1.0:1783137738.941451:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783137738.941460:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322479744:12345-0@lo:400: 00000100:00100000:1.0:1783137738.941512:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322479744:12345-0@lo:400: Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137738.941520:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783137738.941601:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7ce00 x1869755322479744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137738.941618:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322479744:0@lo:400: 00000100:00100000:2.0:1783137738.942094:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322479488:0@lo:400: 00000100:00100000:2.0:1783137738.942237:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137738.942277:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137738.942283:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322479616:0@lo:400: 00000100:00100000:2.0:1783137738.942307:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137738.942336:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479616 00000100:00100000:2.0:1783137738.942340:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479616 00000100:00100000:2.0:1783137738.942367:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137738.942373:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322479616:12345-0@lo:400: 00000100:00100000:2.0:1783137738.942417:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322479616:12345-0@lo:400: Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137738.942423:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783137738.942456:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7d880 x1869755322479616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137738.942467:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322479616:0@lo:400: 00000100:00100000:3.0:1783137738.942603:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479872 00000100:00100000:3.0:1783137738.942608:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479872 00000100:00100000:3.0:1783137738.942647:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137738.942655:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322479872:12345-0@lo:400: 00000100:00100000:3.0:1783137738.942698:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322479872:12345-0@lo:400: Request processed in 44us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137738.942704:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783137738.942720:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137738.942724:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783137738.942747:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f7ea00 x1869755322479872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137738.942757:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322479872:0@lo:400: 00000100:00100000:1.0:1783137738.944261:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322479488 00000100:00100000:1.0:1783137738.944273:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322479488 00000100:00100000:1.0:1783137738.944316:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783137738.944325:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3316:x1869755322479488:12345-0@lo:400: 00000100:00100000:1.0:1783137738.944405:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3316:x1869755322479488:12345-0@lo:400: Request processed in 81us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137738.944412:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783137738.944602:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322479488:0@lo:400: 00010000:00010000:2.0:1783137739.259041:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137739.453887:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322480000:0@lo:13: 00000100:00100000:3.0:1783137739.453963:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137739.454041:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480000 00000100:00100000:1.0:1783137739.454049:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480000 00000100:00100000:1.0:1783137739.454097:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137739.454105:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322480000:12345-0@lo:13: 00002000:00000024:1.0:1783137739.454153:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137739.454204:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322480000:12345-0@lo:13: Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137739.454211:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783137739.454312:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4204700 x1869755322480000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137739.454330:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322480000:0@lo:13: 00000020:01000004:1.0:1783137740.173832:0:7504:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783137740.173836:0:7504:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783137740.173977:0:7504:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e5dc5c0e000 00000020:01000004:1.0:1783137740.173995:0:7504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783137740.174009:0:7504:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783137740.174033:0:7504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e5df5e4cd40) 00000020:00000080:1.0:1783137740.174050:0:7504:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783137740.206445:0:7504:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783137740.207245:0:7504:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783137740.236872:0:7504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783137740.246515:0:7504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783137740.246642:0:7504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783137740.246876:0:7504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783137740.246986:0:7504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783137740.247731:0:7504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783137740.247746:0:7504:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783137740.247830:0:7504:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4691dfc3d66b6ec3 00000020:01000004:3.0:1783137740.247842:0:7504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783137740.247866:0:7504:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783137740.247871:0:7504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783137740.247877:0:7504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783137740.247902:0:7504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783137740.247906:0:7504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783137740.281502:0:7504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783137740.281851:0:7504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783137740.281856:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783137740.281858:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137740.281860:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137740.281861:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137740.281862:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137740.281864:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137740.281866:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137740.281867:0:7504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137740.281869:0:7504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137740.281871:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137740.281872:0:7504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137740.281877:0:7504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783137740.281886:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137740.281887:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137740.281888:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137740.281889:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137740.281889:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137740.281890:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137740.281891:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137740.281892:0:7504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137740.281893:0:7504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137740.281894:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137740.281895:0:7504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137740.281992:0:7504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783137740.282018:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322480128:0@lo:253: 00000100:00100000:1.0:1783137740.282270:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137740.282380:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137740.282506:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480128 00000100:00100000:3.0:1783137740.282514:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480128 00010000:00010000:2.0:1783137740.283039:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.283097:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783137740.283121:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:7504:x1869755322480128:12345-0@lo:253: 20000000:01000000:0.0:1783137740.283164:0:5806:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783137740.283169:0:5806:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783137740.283174:0:5806:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783137740.283177:0:5806:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1783137740.285043:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137740.285468:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783137740.285483:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783137740.285527:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783137740.285535:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783137740.286009:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783137740.286633:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783137740.287525:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783137740.287889:0:5806:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:0.0:1783137740.287892:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:0.0:1783137740.288008:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783137740.288018:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783137740.288072:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783137740.288270:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:0.0:1783137740.288309:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783137740.288319:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783137740.288352:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783137740.288403:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783137740.290385:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1783137740.290419:0:5806:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.124@tcp 20000000:01000000:0.0:1783137740.290421:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.124@tcp (null) (null) (null) 00000040:00080000:0.0:1783137740.290458:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1783137740.290464:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783137740.290492:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1783137740.290499:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.124@tcp (null) (null) 00000040:00080000:0.0:1783137740.291046:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1783137740.291060:0:5806:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783137740.291298:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1783137740.291409:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1783137740.291431:0:5806:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783137740.291434:0:5806:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783137740.291437:0:5806:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783137740.291450:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783137740.291453:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783137740.291490:0:5806:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783137740.291492:0:5806:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783137740.294202:0:7506:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1783137740.294314:0:7506:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1783137740.294727:0:7506:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783137740.295515:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1783137740.295652:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1783137740.295692:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1783137740.295707:0:5806:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783137740.295711:0:5806:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783137740.296965:0:7507:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783137740.297048:0:7507:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783137740.297220:0:7507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1783137740.297530:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1783137740.297706:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1783137740.297762:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1783137740.297777:0:5806:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783137740.297780:0:5806:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783137740.302271:0:7508:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1783137740.302375:0:7508:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1783137740.302433:0:7508:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1783137740.306285:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1783137740.306338:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1783137740.306411:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1783137740.306427:0:5806:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783137740.306429:0:5806:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783137740.307856:0:7509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1783137740.309541:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1783137740.310521:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1783137740.310690:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1783137740.310714:0:5806:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1783137740.310716:0:5806:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1783137740.310732:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783137740.310753:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311275:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311284:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311291:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311297:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311303:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311312:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311354:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.311369:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.311384:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480256:0@lo:104: 00000100:00100000:1.0:1783137740.311446:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137740.311497:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137740.311506:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1783137740.311515:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137740.311522:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480256 00000100:00100000:1.0:1783137740.311523:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480384:0@lo:104: 00000100:00100000:3.0:1783137740.311528:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480256 00000100:00100000:3.0:1783137740.311667:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137740.311678:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dea38a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322480256:12345-0@lo:104: 00010000:00010000:3.0:1783137740.311690:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137740.311850:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137740.311864:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dea38a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322480256:12345-0@lo:104: Request processed in 187us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137740.311870:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783137740.311934:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137740.311947:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.311953:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045e00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137740.311957:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.311964:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137740.311971:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137740.311975:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137740.312010:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.312016:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783137740.312071:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322480512:0@lo:103: 00000100:00100000:3.0:1783137740.312100:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137740.312258:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.312267:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6eb5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.312285:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.312287:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.312288:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.312301:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480512 00000100:00100000:0.0:1783137740.312306:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480512 00010000:00010000:0.0:1783137740.312326:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 17 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.312351:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.312373:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137740.312380:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3317:x1869755322480512:12345-0@lo:103: 00010000:00010000:0.0:1783137740.312392:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137740.312397:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 17 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.312407:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 17 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.312416:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.312429:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 17 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.312438:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480640:0@lo:104: 00000100:00100000:1.0:1783137740.312461:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137740.312524:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137740.313430:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3317:x1869755322480512:12345-0@lo:103: Request processed in 1045us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.313439:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783137740.313480:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.313491:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 16 pid: 5807 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.313501:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480768:0@lo:104: 00000100:00100000:3.0:1783137740.313510:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322480512:0@lo:103: 00000100:00100000:1.0:1783137740.313528:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.314101:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480384 00000100:00100000:2.0:1783137740.314118:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480384 00000100:00100000:2.0:1783137740.314166:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480640 00000100:00100000:2.0:1783137740.314169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480640 00000100:00100000:2.0:1783137740.314182:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137740.314190:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:5806:x1869755322480384:12345-0@lo:104: 00010000:00010000:2.0:1783137740.314201:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314259:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137740.314264:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:5806:x1869755322480384:12345-0@lo:104: Request processed in 76us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.314270:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137740.314285:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783137740.314289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322480640:12345-0@lo:104: 00010000:00010000:2.0:1783137740.314297:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314330:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783137740.314334:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322480640:12345-0@lo:104: Request processed in 45us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.314339:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783137740.314354:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137740.314360:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314366:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137740.314370:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314377:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137740.314390:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137740.314395:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783137740.314423:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314430:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137740.314450:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.314450:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137740.314457:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e8b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.314471:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137740.314472:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137740.314474:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137740.314485:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322480896:0@lo:103: 00000100:00100000:2.0:1783137740.314513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137740.315429:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.315444:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.315456:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322481024:0@lo:104: 00000100:00100000:1.0:1783137740.315498:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137740.315541:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13f60c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783137740.315587:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6eae expref: 16 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.315772:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480256:0@lo:104: 00000100:00100000:1.0:1783137740.315787:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480384:0@lo:104: 00000100:00100000:1.0:1783137740.315794:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480640:0@lo:104: 00000100:00100000:2.0:1783137740.315990:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480768 00000100:00100000:2.0:1783137740.315996:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480768 00000100:00100000:2.0:1783137740.316027:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481024 00000100:00100000:2.0:1783137740.316030:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481024 00000100:00100000:2.0:1783137740.316042:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137740.316050:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:5806:x1869755322480768:12345-0@lo:104: 00010000:00010000:2.0:1783137740.316061:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316264:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137740.316278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:5806:x1869755322480768:12345-0@lo:104: Request processed in 228us (2748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.316285:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137740.316300:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137740.316306:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322481024:12345-0@lo:104: 00010000:00010000:2.0:1783137740.316312:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316336:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783137740.316341:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5806:x1869755322481024:12345-0@lo:104: Request processed in 36us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.316346:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1783137740.316372:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137740.316376:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316383:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137740.316387:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316395:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137740.316402:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137740.316408:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783137740.316435:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.316448:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322480896 00010000:00010000:2.0:1783137740.316451:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783137740.316452:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322480896 00010000:00010000:2.0:1783137740.316466:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316471:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316472:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030600/0x4691dfc3d66b6e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e45 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316483:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137740.316486:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.316491:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1783137740.316492:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137740.316495:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.316497:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322480896:12345-0@lo:103: 00010000:00010000:2.0:1783137740.316502:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316507:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1783137740.316508:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316512:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137740.316513:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137740.316522:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316524:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316530:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137740.316573:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316573:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b6e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e84 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.316581:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e1b expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316588:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137740.316610:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137740.316612:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.316613:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3314:x1869755322480896:12345-0@lo:103: Request processed in 117us (2100us total) trans 0 rc 0/0 00010000:00010000:2.0:1783137740.316614:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.316620:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137740.316632:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322481152:0@lo:103: 00000100:00100000:0.0:1783137740.316639:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322481280:0@lo:103: 00000100:00100000:0.0:1783137740.316658:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.316708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.316734:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481280 00000100:00100000:0.0:1783137740.316738:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481280 00010000:00010000:0.0:1783137740.316750:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 15 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.316766:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481152 00000100:00100000:0.0:1783137740.316769:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481152 00010000:00010000:0.0:1783137740.316779:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 16 pid: 5807 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.316793:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137740.316798:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3316:x1869755322481280:12345-0@lo:103: 00010000:00010000:0.0:1783137740.316805:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137740.316809:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316817:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 16 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316837:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137740.316864:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3316:x1869755322481280:12345-0@lo:103: Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.316870:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783137740.316877:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322480896:0@lo:103: 00000100:00100000:0.0:1783137740.316882:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137740.316887:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3315:x1869755322481152:12345-0@lo:103: 00010000:00010000:0.0:1783137740.316894:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137740.316898:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 15 pid: 5807 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316905:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 15 pid: 5807 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.316914:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137740.316937:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3315:x1869755322481152:12345-0@lo:103: Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.316943:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137740.316967:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322481152:0@lo:103: 00000100:00100000:0.0:1783137740.316985:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322481280:0@lo:103: 00010000:00010000:2.0:1783137740.316991:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137740.316993:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137740.316995:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.316996:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.317002:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137740.317005:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.317012:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137740.317025:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137740.317030:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137740.317069:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.317075:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137740.317085:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.317091:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.317103:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.317105:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.317107:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.317112:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137740.317119:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322481408:0@lo:103: 00000100:00100000:0.0:1783137740.317271:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.317321:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481408 00000100:00100000:0.0:1783137740.317324:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481408 00010000:00010000:1.0:1783137740.317451:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e3e expref: 15 pid: 5807 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.317464:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322480768:0@lo:104: 00010000:00010000:1.0:1783137740.317473:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e14 expref: 14 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.317482:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1869755322481024:0@lo:104: 00010000:00010000:1.0:1783137740.317501:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.318311:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137740.318361:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137740.318373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3316:x1869755322481408:12345-0@lo:103: 00010000:00010000:1.0:1783137740.318384:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137740.318389:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318400:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318427:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e68 expref: 13 pid: 5805 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318441:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318448:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318461:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318468:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318475:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318480:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318486:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d5200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137740.318490:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318497:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318519:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.318539:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137740.320910:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.320926:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.320933:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6eca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137740.320956:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783137740.323109:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3316:x1869755322481408:12345-0@lo:103: Request processed in 4729us (5827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.323228:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137740.323285:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322481408:0@lo:103: 00000100:00100000:1.0:1783137740.390217:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:7504:x1869755322480128:12345-0@lo:253: Request processed in 107092us (107938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.390233:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783137740.390354:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322480128:0@lo:253: 10000000:01000000:2.0:1783137740.390370:0:7504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783137740.390374:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137740.390375:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783137740.390377:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137740.390378:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1783137740.390379:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137740.390381:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137740.390382:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783137740.390384:0:7504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783137740.390385:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137740.390394:0:7504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783137740.390419:0:7504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5dc5c0e000 from lustre-OST0001 10000000:01000000:2.0:1783137740.390447:0:7504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783137740.390449:0:7504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783137740.390458:0:7504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5dc5dd19c0 local copy 10000000:01000000:2.0:1783137740.390462:0:7504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783137740.390501:0:7504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.390512:0:7504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.390521:0:7504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137740.390539:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481536:0@lo:101: 00000100:00100000:2.0:1783137740.390618:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.390647:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.390972:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481536 00000100:00100000:0.0:1783137740.390979:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481536 00000100:00100000:0.0:1783137740.391025:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783137740.391035:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:7504:x1869755322481536:12345-0@lo:101: 00010000:00010000:0.0:1783137740.391048:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137740.391062:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030200/0x4691dfc3d66b6ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6ed1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.391087:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030200/0x4691dfc3d66b6ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ed1 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.391097:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030200/0x4691dfc3d66b6ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ed1 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.391105:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030200, rc 0) 00000100:00100000:0.0:1783137740.391147:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322481536:12345-0@lo:101: Request processed in 114us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.391153:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137740.391227:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481536:0@lo:101: 00010000:00010000:2.0:1783137740.391240:0:7504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.391248:0:7504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137740.391425:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481664:0@lo:501: 00000100:00100000:2.0:1783137740.391452:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.391483:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.391532:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481664 00000100:00100000:0.0:1783137740.391536:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481664 00000100:00100000:0.0:1783137740.391595:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137740.391602:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322481664:12345-0@lo:501: 00000100:00100000:0.0:1783137740.391910:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322481664:12345-0@lo:501: Request processed in 308us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137740.391917:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783137740.392037:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481664:0@lo:501: 10000000:01000000:2.0:1783137740.392050:0:7504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783137740.392081:0:7504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783137740.392087:0:7504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.392095:0:7504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.392102:0:7504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.392124:0:7504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783137740.392143:0:7504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5dc5c0e000 10000000:01000000:2.0:1783137740.392147:0:7504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783137740.392152:0:7504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783137740.392155:0:7504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137740.392158:0:7504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783137740.392161:0:7504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783137740.392179:0:7504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.392186:0:7504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.392195:0:7504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137740.392207:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481792:0@lo:101: 00000100:00100000:2.0:1783137740.392235:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.392307:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51d80 going to sleep for 11 seconds 00010000:00010000:0.0:1783137740.392363:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137740.392368:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392386:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137740.392390:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392398:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137740.392404:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137740.392409:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137740.392426:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392431:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137740.392457:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392464:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4691dfc3d66b6ed8 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392477:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.392479:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.392480:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.392488:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137740.392498:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322481920:0@lo:103: 00000100:00100000:0.0:1783137740.392526:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.392590:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481920 00000100:00100000:0.0:1783137740.392594:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481920 00000100:00100000:0.0:1783137740.392635:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783137740.392642:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:3315:x1869755322481920:12345-0@lo:103: 00010000:00010000:0.0:1783137740.392651:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137740.392728:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030200/0x4691dfc3d66b6ed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6ed1 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.392743:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137740.392773:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:3315:x1869755322481920:12345-0@lo:103: Request processed in 131us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.392779:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783137740.392806:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322481920:0@lo:103: 00000100:00100000:1.0:1783137740.393070:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322481792 00000100:00100000:1.0:1783137740.393075:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322481792 00000100:00100000:1.0:1783137740.393135:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137740.393143:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+11:7504:x1869755322481792:12345-0@lo:101: 00010000:00010000:1.0:1783137740.393153:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137740.393165:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6edf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.393182:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.393191:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.393197:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5600, rc 0) 00000100:00100000:1.0:1783137740.393235:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322481792:12345-0@lo:101: Request processed in 93us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.393240:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783137740.393304:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322481792:0@lo:101: 00010000:00010000:2.0:1783137740.393323:0:7504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.393343:0:7504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137740.393417:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482048:0@lo:501: 00000100:00100000:2.0:1783137740.393442:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.393807:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.393858:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482048 00000100:00100000:0.0:1783137740.393863:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482048 00000100:00100000:0.0:1783137740.393885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137740.393892:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482048:12345-0@lo:501: 00000100:00100000:0.0:1783137740.394103:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482048:12345-0@lo:501: Request processed in 211us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.394111:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783137740.394217:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482048:0@lo:501: 00000100:00100000:2.0:1783137740.394246:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482176:0@lo:503: 00000100:00100000:2.0:1783137740.394288:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.394310:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.394466:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482176 00000100:00100000:0.0:1783137740.394471:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482176 00000100:00100000:0.0:1783137740.394502:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137740.394508:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482176:12345-0@lo:503: 00000100:00100000:1.0:1783137740.395154:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482176:12345-0@lo:503: Request processed in 643us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.395162:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783137740.395255:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482176:0@lo:503: 00000040:00080000:2.0:1783137740.395531:0:7504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783137740.395866:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482304:0@lo:502: 00000100:00100000:2.0:1783137740.395912:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.395953:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.396257:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482304 00000100:00100000:1.0:1783137740.396262:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482304 00000100:00100000:1.0:1783137740.396308:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783137740.396324:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482304:12345-0@lo:502: 00000100:00100000:1.0:1783137740.396517:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482304:12345-0@lo:502: Request processed in 193us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.396524:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783137740.396856:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482304:0@lo:502: 00000040:00080000:0.0:1783137740.397132:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783137740.397184:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783137740.397218:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783137740.397267:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783137740.397315:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783137740.397360:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783137740.397391:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482432:0@lo:502: 00000100:00100000:0.0:1783137740.397439:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.397466:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137740.397754:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482432 00000100:00100000:2.0:1783137740.397760:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482432 00000100:00100000:2.0:1783137740.397793:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137740.397799:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482432:12345-0@lo:502: 00000100:00100000:2.0:1783137740.397961:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482432:12345-0@lo:502: Request processed in 161us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.397967:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137740.398177:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482432:0@lo:502: 00000040:00080000:0.0:1783137740.398273:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783137740.398283:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1783137740.399129:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783137740.399138:0:7513:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783137740.399144:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137740.399146:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783137740.399151:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783137740.399167:0:7513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e5dc7ef19c0) 00000020:00000080:0.0:1783137740.399188:0:7513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783137740.399193:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783137740.399254:0:7513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dc5c0e000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783137740.399262:0:7513:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783137740.399269:0:7513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4691dfc3d66b6ef4 00010000:00010000:2.0:1783137740.418019:0:7513:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1783137740.419479:0:7513:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783137740.424518:0:7513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783137740.431409:0:7513:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783137740.441944:0:7513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783137740.442429:0:7513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783137740.446267:0:7513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783137740.446279:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137740.446285:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137740.446288:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783137740.446293:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137740.446298:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137740.446299:0:7513:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783137740.446302:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783137740.446304:0:7513:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783137740.446360:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137740.446364:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137740.446366:0:7513:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137740.446369:0:7513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783137740.446707:0:7504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783137740.446740:0:7504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783137740.446768:0:7504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.446780:0:7504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137740.446788:0:7504:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5c0e000 from 1 10000000:01000000:2.0:1783137740.446791:0:7504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137740.447328:0:7504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.447339:0:7504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.447351:0:7504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137740.447374:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482560:0@lo:101: 00000100:00100000:2.0:1783137740.447455:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137740.447495:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b51480 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.447640:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482560 00000100:00100000:1.0:1783137740.447648:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482560 00000100:00100000:1.0:1783137740.447707:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783137740.447717:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:7504:x1869755322482560:12345-0@lo:101: 00010000:00010000:1.0:1783137740.447731:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137740.447744:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6efb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.447773:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.447784:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137740.447810:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d4a00, rc 0) 00000100:00100000:1.0:1783137740.448042:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482560:12345-0@lo:101: Request processed in 326us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.448050:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783137740.448135:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482560:0@lo:101: 00010000:00010000:3.0:1783137740.448149:0:7504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137740.448165:0:7504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137740.448267:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482688:0@lo:501: 00000100:00100000:3.0:1783137740.448292:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137740.448315:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.448433:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482688 00000100:00100000:1.0:1783137740.448438:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482688 00000100:00100000:1.0:1783137740.448469:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783137740.448475:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482688:12345-0@lo:501: 00000100:00100000:1.0:1783137740.448737:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482688:12345-0@lo:501: Request processed in 260us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.448744:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783137740.449346:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482688:0@lo:501: 00000100:00100000:3.0:1783137740.449387:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482816:0@lo:503: 00000100:00100000:3.0:1783137740.449433:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137740.449476:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.449772:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482816 00000100:00100000:1.0:1783137740.449778:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482816 00000100:00100000:1.0:1783137740.449818:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783137740.449942:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482816:12345-0@lo:503: 00000100:00100000:1.0:1783137740.450400:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482816:12345-0@lo:503: Request processed in 573us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.450407:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783137740.450603:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482816:0@lo:503: 00000040:00080000:3.0:1783137740.451065:0:7504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783137740.451265:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482944:0@lo:502: 00000100:00100000:3.0:1783137740.451313:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137740.451350:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.451585:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322482944 00000100:00100000:1.0:1783137740.451591:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322482944 00000100:00100000:1.0:1783137740.451620:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783137740.451627:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482944:12345-0@lo:502: 00000100:00100000:1.0:1783137740.451998:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322482944:12345-0@lo:502: Request processed in 370us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.452005:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783137740.452251:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322482944:0@lo:502: 00000040:00080000:3.0:1783137740.452617:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783137740.452738:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783137740.452899:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483072:0@lo:502: 00000100:00100000:3.0:1783137740.452943:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137740.452976:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137740.453065:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483072 00000100:00100000:1.0:1783137740.453077:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483072 00000100:00100000:1.0:1783137740.453286:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137740.453296:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322483072:12345-0@lo:502: 00000100:00100000:1.0:1783137740.454273:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322483072:12345-0@lo:502: Request processed in 973us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137740.454282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783137740.454388:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483072:0@lo:502: 00000040:00080000:3.0:1783137740.455021:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783137740.455034:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783137740.455795:0:7516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137740.455806:0:7516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137740.455808:0:7516:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783137740.455814:0:7516:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dc5c0e000 00000020:00000080:3.0:1783137740.455816:0:7516:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137740.455849:0:7516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137740.455852:0:7516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137740.455853:0:7516:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783137740.455856:0:7516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783137740.456047:0:7504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783137740.456068:0:7504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137740.456090:0:7504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.456101:0:7504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137740.456157:0:7504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783137740.456160:0:7504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5dc5c0e000 10000000:01000000:0.0:1783137740.456164:0:7504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5dc5c0e000 10000000:01000000:0.0:1783137740.456168:0:7504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137740.456182:0:7504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dc5c0e000 from 1 10000000:01000000:0.0:1783137740.456185:0:7504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137740.456217:0:7504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.456226:0:7504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.456235:0:7504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.456255:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483200:0@lo:101: 00000100:00100000:0.0:1783137740.456314:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.456358:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc60c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137740.456614:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483200 00000100:00100000:2.0:1783137740.456622:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483200 00000100:00100000:2.0:1783137740.456671:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783137740.456689:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322483200:12345-0@lo:101: 00010000:00010000:2.0:1783137740.456705:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137740.456717:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f09 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.456741:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.456751:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137740.456770:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045800, rc 0) 00000100:00100000:2.0:1783137740.456813:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483200:12345-0@lo:101: Request processed in 127us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.456819:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137740.457024:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483200:0@lo:101: 00010000:00010000:0.0:1783137740.457040:0:7504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.457048:0:7504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.457171:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483328:0@lo:501: 00000100:00100000:0.0:1783137740.457200:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.457229:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc60c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137740.457401:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483328 00000100:00100000:2.0:1783137740.457406:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483328 00000100:00100000:2.0:1783137740.457447:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783137740.457454:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483328:12345-0@lo:501: 00000100:00100000:2.0:1783137740.457728:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483328:12345-0@lo:501: Request processed in 274us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.457735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137740.458626:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483328:0@lo:501: 00000100:00100000:0.0:1783137740.458684:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483456:0@lo:503: 00000100:00100000:0.0:1783137740.458741:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.458788:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc60c90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137740.459339:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483456 00000100:00100000:3.0:1783137740.459347:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483456 00000100:00100000:3.0:1783137740.459390:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783137740.459400:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483456:12345-0@lo:503: 00000100:00100000:3.0:1783137740.459626:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483456:12345-0@lo:503: Request processed in 227us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137740.459634:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783137740.461096:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483456:0@lo:503: 00000040:00080000:0.0:1783137740.461454:0:7504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137740.461531:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483584:0@lo:502: 00000100:00100000:0.0:1783137740.461682:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.461725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483584 00000100:00100000:0.0:1783137740.461730:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483584 00000100:00100000:0.0:1783137740.461782:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783137740.461791:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483584:12345-0@lo:502: 00000100:00100000:0.0:1783137740.465952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483584:12345-0@lo:502: Request processed in 4152us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.465966:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783137740.466041:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.466066:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483584:0@lo:502: 00000040:00080000:0.0:1783137740.466386:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783137740.466442:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783137740.466475:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783137740.466520:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783137740.466595:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783137740.466663:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783137740.466697:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783137740.466728:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783137740.466771:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783137740.466804:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783137740.466837:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783137740.466898:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783137740.466938:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783137740.466970:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783137740.467031:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783137740.467069:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783137740.467113:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783137740.467170:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783137740.467208:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783137740.467242:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783137740.467305:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783137740.467360:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783137740.467396:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783137740.467457:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783137740.467497:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783137740.467532:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783137740.467628:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783137740.467662:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783137740.467697:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783137740.467745:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783137740.467781:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783137740.467814:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783137740.467847:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783137740.467891:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783137740.467925:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783137740.467967:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783137740.467999:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783137740.468049:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483712:0@lo:502: 00000100:00100000:0.0:1783137740.468126:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.468164:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137740.468836:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483712 00000100:00100000:2.0:1783137740.468844:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483712 00000100:00100000:2.0:1783137740.468910:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783137740.468921:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483712:12345-0@lo:502: 00000100:00100000:2.0:1783137740.469186:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322483712:12345-0@lo:502: Request processed in 266us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.469203:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783137740.472861:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322483712:0@lo:502: 00000040:00080000:0.0:1783137740.473042:0:7504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1783137740.473059:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1783137740.479926:0:7518:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783137740.479944:0:7518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e5dc7ef4d40) 00000020:00000080:0.0:1783137740.479969:0:7518:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1783137740.480508:0:7518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dc5c0e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783137740.480518:0:7518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dc5c0e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783137740.480521:0:7518:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5c0e000 3 00010000:00080000:0.0:1783137740.480589:0:7518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dfb0d6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1783137740.482208:0:7518:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1783137740.482305:0:7518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783137740.482340:0:7518:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783137740.482352:0:7518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4691dfc3d66b6f1e 00000100:00080000:0.0:1783137740.482363:0:7518:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137740.482370:0:7518:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5dfb0d6800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137740.482408:0:7518:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5f8bb80 x1869755322483840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783137740.482435:0:7518:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783137740.482519:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322483968:0@lo:400: 00000100:00100000:3.0:1783137740.482623:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322483840:0@lo:38: 00000100:00100000:0.0:1783137740.482623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137740.482658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.482676:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322484096:0@lo:400: 00000100:00100000:0.0:1783137740.482700:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.482732:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137740.482738:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322484224:0@lo:400: 00000100:00100000:3.0:1783137740.482752:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483968 00000100:00100000:3.0:1783137740.482765:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483968 00000100:00100000:0.0:1783137740.482765:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.482793:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322483840 00000100:00100000:0.0:1783137740.482797:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322483840 00000100:00100000:3.0:1783137740.483302:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484096 00000100:00100000:3.0:1783137740.483307:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484096 00000100:00080000:1.0:1783137740.483380:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137740.485402:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137740.485420:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322483968:12345-0@lo:400: 00000100:00100000:0.0:1783137740.485528:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322483968:12345-0@lo:400: Request processed in 114us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.485536:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783137740.485605:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f89880 x1869755322483968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137740.485622:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322483968:0@lo:400: 00000100:00100000:0.0:1783137740.486183:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137740.486203:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322484096:12345-0@lo:400: 00000100:00100000:0.0:1783137740.486259:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322484096:12345-0@lo:400: Request processed in 59us (3558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.486264:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137740.486334:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137740.486340:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1869755322483840:12345-0@lo:38: 00010000:00080000:0.0:1783137740.486361:0:5812:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1783137740.486395:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4691dfc3d66b6f25 00000004:00100000:0.0:1783137740.486411:0:5812:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783137740.486442:0:5812:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137740.486483:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869755322483840:12345-0@lo:38: Request processed in 142us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.486490:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137740.486520:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484224 00000100:00100000:0.0:1783137740.486526:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484224 00000100:00100000:0.0:1783137740.486596:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137740.486603:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322484224:12345-0@lo:400: 00000100:00100000:0.0:1783137740.486650:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322484224:12345-0@lo:400: Request processed in 48us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.486657:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783137740.486694:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f8bb80 x1869755322483840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783137740.487095:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f88a80 x1869755322484224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137740.487227:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322484224:0@lo:400: 00010000:00080000:1.0:1783137740.487248:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5f8aa00 x1869755322484096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137740.487258:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322484096:0@lo:400: 00000100:00080000:3.0:1783137740.487624:0:7520:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8e5dc4206d80 x1869755322484352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137740.487635:0:7520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 0 seconds 00000040:00080000:3.0:1783137740.487708:0:7518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1783137740.487802:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137740.487810:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783137740.487817:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783137740.487822:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783137740.487832:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1783137740.487839:0:3313:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000726a18a1): req@ffff8e5dc4206d80 x1869755322484352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137740.487856:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322483840:0@lo:38: 00000100:00080000:1.0:1783137740.487886:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1783137740.487906:0:7504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:0.0:1783137740.487924:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783137740.487935:0:7504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137740.487951:0:7504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.487956:0:7520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137740.487958:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484352 00000100:00100000:2.0:1783137740.487963:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484352 00010000:00010000:1.0:1783137740.487966:0:7504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783137740.487989:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137740.488006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137740.488014:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7520:x1869755322484352:12345-0@lo:901: 00000020:01000004:1.0:1783137740.488030:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783137740.488036:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137740.488037:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137740.488038:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137740.488039:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137740.488041:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137740.488043:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137740.488044:0:7504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137740.488045:0:7504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137740.488047:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137740.488048:0:7504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137740.488052:0:7504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783137740.488054:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137740.488056:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137740.488057:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137740.488057:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137740.488059:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137740.488060:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137740.488061:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137740.488063:0:7504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137740.488063:0:7504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137740.488064:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137740.488065:0:7504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137740.488081:0:7504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783137740.488091:0:7504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322484480:0@lo:253: 00000100:00100000:2.0:1783137740.489251:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7520:x1869755322484352:12345-0@lo:901: Request processed in 1234us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137740.489261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783137740.489396:0:7520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dc4206d80 x1869755322484352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783137756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137740.489408:0:7520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7520:1869755322484352:0@lo:901: 00000100:00100000:1.0:1783137740.489782:0:7504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137740.489859:0:7504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc515e480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.491250:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484480 00000100:00100000:0.0:1783137740.491261:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484480 00000100:00100000:0.0:1783137740.491320:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137740.491331:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7504:x1869755322484480:12345-0@lo:253: 20000000:01000000:0.0:1783137740.491363:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783137740.491379:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783137740.519482:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783137740.519497:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783137740.519532:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783137740.519536:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783137740.519603:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.519624:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.519633:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.519694:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.519708:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.519724:0:5827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322484608:0@lo:104: 00000100:00100000:0.0:1783137740.519807:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.519847:0:5827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb157480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137740.519867:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484608 00000100:00100000:0.0:1783137740.519873:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484608 00000100:00100000:0.0:1783137740.519918:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137740.519929:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322484608:12345-0@lo:104: 00010000:00010000:0.0:1783137740.519944:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.519994:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137740.520001:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:5827:x1869755322484608:12345-0@lo:104: Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.520008:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783137740.520033:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137740.520038:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520045:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137740.520049:0:7510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520068:0:7510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137740.520076:0:7510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137740.520082:0:7510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137740.520111:0:7510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520118:0:7510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137740.520136:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520143:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e7d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520160:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.520162:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137740.520163:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137740.520180:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322484736:0@lo:103: 00000100:00100000:0.0:1783137740.520210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137740.520243:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484736 00000100:00100000:0.0:1783137740.520247:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484736 00010000:00010000:0.0:1783137740.520263:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 15 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.520283:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137740.520289:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3314:x1869755322484736:12345-0@lo:103: 00010000:00010000:0.0:1783137740.520304:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137740.520309:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 15 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520319:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 15 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520334:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520341:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783137740.520352:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001922242s 00010000:00010000:0.0:1783137740.520356:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520363:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520370:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520376:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520381:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137740.520385:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520392:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520403:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520411:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137740.520436:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3314:x1869755322484736:12345-0@lo:103: Request processed in 147us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.520442:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137740.520491:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322484736:0@lo:103: 00010000:00010000:0.0:1783137740.520511:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5400/0x4691dfc3d66b6e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e76 expref: 14 pid: 5806 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.520519:0:5827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1869755322484608:0@lo:104: 00010000:00010000:0.0:1783137740.520529:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520537:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520576:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137740.520583:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b6f2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137740.536213:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:7504:x1869755322484480:12345-0@lo:253: Request processed in 44873us (46420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137740.536229:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783137740.536318:0:7504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83444777-5c31-482f-a1f5-fb6cbc8d0848:7504:1869755322484480:0@lo:253: 10000000:01000000:1.0:1783137740.536336:0:7504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783137740.536339:0:7504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137740.536342:0:7504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137740.536343:0:7504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137740.536344:0:7504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137740.536346:0:7504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137740.536348:0:7504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137740.536349:0:7504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137740.536351:0:7504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137740.536353:0:7504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137740.536354:0:7504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137740.536371:0:7504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783137740.536396:0:7504:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783137740.544273:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137740.544478:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137740.544936:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137740.545121:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137740.545352:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137740.545969:0:7504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783137740.547394:0:7504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783137740.842709:0:7504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783137740.842716:0:7504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783137740.842748:0:7504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783137740.842812:0:7504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783137740.842828:0:7504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783137740.842853:0:7504:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783137741.308463:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137742.333479:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137743.377058:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137744.386859:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137744.571757:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137744.571799:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322484864:0@lo:13: 00000100:00100000:3.0:1783137744.571905:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137744.571993:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484864 00000100:00100000:3.0:1783137744.572004:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484864 00000100:00100000:3.0:1783137744.572090:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137744.572102:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322484864:12345-0@lo:13: 00002000:00000024:3.0:1783137744.572153:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137744.572209:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322484864:12345-0@lo:13: Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137744.572217:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783137744.572244:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783137744.572282:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc4205f80 x1869755322484864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137744.572305:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322484864:0@lo:13: 00010000:00010000:2.0:1783137745.404159:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137745.594935:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322485248:0@lo:400: 00000100:00100000:1.0:1783137745.595036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137745.595124:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137745.595131:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322485376:0@lo:400: 00000100:00100000:1.0:1783137745.595162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137745.595218:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485248 00000100:00100000:1.0:1783137745.595229:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485248 00000100:00100000:1.0:1783137745.595298:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137745.595311:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322485248:12345-0@lo:400: 00000100:00100000:1.0:1783137745.595374:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322485248:12345-0@lo:400: Request processed in 66us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137745.595382:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137745.595412:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485376 00000100:00100000:1.0:1783137745.595416:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485376 00000100:00100000:1.0:1783137745.595445:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137745.595453:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322485376:12345-0@lo:400: 00000100:00100000:1.0:1783137745.595485:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322485376:12345-0@lo:400: Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137745.595490:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783137745.595507:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783137745.595615:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7f100 x1869755322485376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137745.595631:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322485376:0@lo:400: 00010000:00080000:1.0:1783137745.595644:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7ea00 x1869755322485248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137745.595653:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322485248:0@lo:400: 00000100:00100000:0.0:1783137745.595875:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322484992:0@lo:400: 00000100:00100000:0.0:1783137745.595933:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137745.595971:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322485504:0@lo:400: 00000100:00100000:0.0:1783137745.595999:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137745.596025:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137745.596031:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322485120:0@lo:400: 00000100:00100000:0.0:1783137745.596054:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137745.596082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485504 00000100:00100000:0.0:1783137745.596087:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485504 00000100:00100000:0.0:1783137745.596119:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485120 00000100:00100000:0.0:1783137745.596123:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485120 00000100:00100000:0.0:1783137745.596140:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137745.596146:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322485504:12345-0@lo:400: 00000100:00100000:0.0:1783137745.596192:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322485504:12345-0@lo:400: Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137745.596198:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137745.596213:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137745.596219:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322485120:12345-0@lo:400: 00000100:00100000:0.0:1783137745.596247:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322485120:12345-0@lo:400: Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137745.596265:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783137745.596293:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7df80 x1869755322485120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137745.596303:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322485120:0@lo:400: 00010000:00080000:0.0:1783137745.596312:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7e300 x1869755322485504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137745.596319:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322485504:0@lo:400: 00000100:00100000:1.0:1783137745.596459:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322484992 00000100:00100000:1.0:1783137745.596464:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322484992 00000100:00100000:1.0:1783137745.596505:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783137745.596512:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3316:x1869755322484992:12345-0@lo:400: 00000100:00100000:1.0:1783137745.596588:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:3316:x1869755322484992:12345-0@lo:400: Request processed in 76us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137745.596596:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783137745.596624:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137745.596643:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322484992:0@lo:400: 00010000:00010000:0.0:1783137746.426795:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783137746.619893:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783137746.619902:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dc5ce5000 from 30 10000000:01000000:1.0:1783137746.619909:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137746.619960:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.619974:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.619986:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137746.620017:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485632:0@lo:101: 00000100:00100000:1.0:1783137746.620123:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.620187:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133f900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.620243:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485632 00000100:00100000:0.0:1783137746.620252:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485632 00000100:00100000:0.0:1783137746.620317:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137746.620329:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322485632:12345-0@lo:101: 00010000:00010000:0.0:1783137746.620346:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137746.620362:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f33 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.620392:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.620404:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.620414:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031600, rc 0) 00000100:00100000:0.0:1783137746.620470:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322485632:12345-0@lo:101: Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.620477:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783137746.620627:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485632:0@lo:101: 00010000:00010000:2.0:1783137746.620648:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.620658:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.620725:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485760:0@lo:501: 00000100:00100000:2.0:1783137746.620757:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.620777:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.620792:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485760 00000100:00100000:2.0:1783137746.620795:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485760 00000100:00100000:2.0:1783137746.620823:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783137746.620829:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322485760:12345-0@lo:501: 00000100:00100000:2.0:1783137746.621244:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322485760:12345-0@lo:501: Request processed in 413us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.621251:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783137746.621297:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485760:0@lo:501: 00000100:00100000:2.0:1783137746.621334:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485888:0@lo:503: 00000100:00100000:2.0:1783137746.621375:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.621390:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.621401:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322485888 00000100:00100000:2.0:1783137746.621404:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322485888 00000100:00100000:2.0:1783137746.621426:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783137746.621434:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322485888:12345-0@lo:503: 00000100:00100000:2.0:1783137746.621774:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322485888:12345-0@lo:503: Request processed in 340us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.621781:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783137746.621821:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322485888:0@lo:503: 00000100:00100000:3.0:1783137746.635503:0:7786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7786:1869755322486016:0@lo:502: 00000100:00100000:3.0:1783137746.635664:0:7786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.635721:0:7786:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b180 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.638535:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486016 00000100:00100000:0.0:1783137746.638598:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486016 00000100:00100000:0.0:1783137746.638674:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137746.638685:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7786:x1869755322486016:12345-0@lo:502: 00000100:00100000:0.0:1783137746.644710:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7786:x1869755322486016:12345-0@lo:502: Request processed in 6010us (9031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.644733:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137746.648419:0:7786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7786:1869755322486016:0@lo:502: 00000100:00100000:0.0:1783137746.648540:0:7786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7786:1869755322486144:0@lo:502: 00000100:00100000:0.0:1783137746.648721:0:7786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137746.648773:0:7786:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb098f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.648881:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486144 00000100:00100000:1.0:1783137746.648890:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486144 00000100:00100000:1.0:1783137746.648950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137746.648962:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7786:x1869755322486144:12345-0@lo:502: 00000100:00100000:1.0:1783137746.649275:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:7786:x1869755322486144:12345-0@lo:502: Request processed in 314us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.649285:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137746.649345:0:7786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7786:1869755322486144:0@lo:502: 00000040:00080000:1.0:1783137746.649374:0:7786:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783137746.649576:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783137746.649605:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137746.649618:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649630:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137746.649641:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783137746.649645:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783137746.649648:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137746.649683:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649692:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649702:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137746.649727:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486272:0@lo:101: 00000100:00100000:1.0:1783137746.649761:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.649791:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.649806:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486272 00000100:00100000:1.0:1783137746.649810:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486272 00000100:00100000:1.0:1783137746.649841:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783137746.649848:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322486272:12345-0@lo:101: 00010000:00010000:1.0:1783137746.649857:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137746.649871:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f41 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649897:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649908:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.649917:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5200, rc 0) 00000100:00100000:1.0:1783137746.649946:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486272:12345-0@lo:101: Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.649953:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783137746.649986:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486272:0@lo:101: 00010000:00010000:1.0:1783137746.649999:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.650009:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137746.650070:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486400:0@lo:501: 00000100:00100000:1.0:1783137746.650096:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.650108:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.650120:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486400 00000100:00100000:1.0:1783137746.650124:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486400 00000100:00100000:1.0:1783137746.650140:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783137746.650145:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486400:12345-0@lo:501: 00000100:00100000:1.0:1783137746.650414:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486400:12345-0@lo:501: Request processed in 267us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.650422:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783137746.650450:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486400:0@lo:501: 00000100:00100000:1.0:1783137746.650477:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486528:0@lo:503: 00000100:00100000:1.0:1783137746.650530:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.650580:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.650592:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486528 00000100:00100000:1.0:1783137746.650595:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486528 00000100:00100000:1.0:1783137746.650613:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137746.650620:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486528:12345-0@lo:503: 00000100:00100000:1.0:1783137746.650918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486528:12345-0@lo:503: Request processed in 297us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.650925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137746.650960:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486528:0@lo:503: 00000100:00100000:2.0:1783137746.653117:0:7793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7793:1869755322486656:0@lo:502: 00000100:00100000:2.0:1783137746.653217:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.653271:0:7793:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.653327:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486656 00000100:00100000:0.0:1783137746.653335:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486656 00000100:00100000:0.0:1783137746.653393:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783137746.653404:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:7793:x1869755322486656:12345-0@lo:502: 00000100:00100000:0.0:1783137746.653747:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:7793:x1869755322486656:12345-0@lo:502: Request processed in 343us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.653756:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783137746.653867:0:7793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7793:1869755322486656:0@lo:502: 00000020:01000000:2.0:1783137746.653902:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137746.653913:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137746.653916:0:7793:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783137746.653923:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783137746.653926:0:7793:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783137746.653949:0:7793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7793:1869755322486784:0@lo:502: 00000100:00100000:2.0:1783137746.653984:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.655107:0:7793:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.655243:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486784 00000100:00100000:0.0:1783137746.655251:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486784 00000100:00100000:0.0:1783137746.655311:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783137746.655321:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:7793:x1869755322486784:12345-0@lo:502: 00000100:00100000:0.0:1783137746.661654:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:7793:x1869755322486784:12345-0@lo:502: Request processed in 6321us (7655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.661673:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783137746.661947:0:7793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7793:1869755322486784:0@lo:502: 00000020:01000000:2.0:1783137746.661997:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137746.662012:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137746.662015:0:7793:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783137746.662023:0:7793:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1783137746.662723:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783137746.662757:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783137746.662777:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.662790:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137746.662802:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783137746.662805:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dd09a3000 from 30 10000000:01000000:1.0:1783137746.662808:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137746.662850:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.662858:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137746.662868:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137746.662893:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486912:0@lo:101: 00000100:00100000:1.0:1783137746.662960:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.663003:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.668641:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322486912 00000100:00100000:2.0:1783137746.668662:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322486912 00000100:00100000:2.0:1783137746.668754:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783137746.668769:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322486912:12345-0@lo:101: 00010000:00010000:2.0:1783137746.668791:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137746.668813:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f4f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.668848:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.668863:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.668874:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045200, rc 0) 00000100:00100000:2.0:1783137746.668983:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322486912:12345-0@lo:101: Request processed in 217us (6023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.668991:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783137746.669078:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322486912:0@lo:101: 00010000:00010000:2.0:1783137746.669099:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.669109:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.669192:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487040:0@lo:501: 00000100:00100000:2.0:1783137746.669252:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.669289:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.669305:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487040 00000100:00100000:2.0:1783137746.669309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487040 00000100:00100000:2.0:1783137746.669335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783137746.669343:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322487040:12345-0@lo:501: 00000100:00100000:2.0:1783137746.669709:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322487040:12345-0@lo:501: Request processed in 365us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.669718:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783137746.669757:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487040:0@lo:501: 00000100:00100000:2.0:1783137746.669792:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487168:0@lo:503: 00000100:00100000:2.0:1783137746.669835:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.669848:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.669860:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487168 00000100:00100000:2.0:1783137746.669863:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487168 00000100:00100000:2.0:1783137746.669886:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783137746.669892:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322487168:12345-0@lo:503: 00000100:00100000:2.0:1783137746.670050:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322487168:12345-0@lo:503: Request processed in 158us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.670056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783137746.670089:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487168:0@lo:503: 00000100:00100000:3.0:1783137746.685732:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7797:1869755322487296:0@lo:502: 00000100:00100000:3.0:1783137746.685851:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.685912:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd209e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.686083:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487296 00000100:00100000:2.0:1783137746.686093:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487296 00000100:00100000:2.0:1783137746.686159:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783137746.686172:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:7797:x1869755322487296:12345-0@lo:502: 00000100:00100000:2.0:1783137746.686478:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:7797:x1869755322487296:12345-0@lo:502: Request processed in 307us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.686492:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783137746.686739:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7797:1869755322487296:0@lo:502: 00000100:00100000:3.0:1783137746.686812:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7797:1869755322487424:0@lo:502: 00000100:00100000:3.0:1783137746.686848:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.686876:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.686980:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487424 00000100:00100000:2.0:1783137746.686985:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487424 00000100:00100000:2.0:1783137746.687021:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137746.687029:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:7797:x1869755322487424:12345-0@lo:502: 00000100:00100000:2.0:1783137746.687193:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:7797:x1869755322487424:12345-0@lo:502: Request processed in 163us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.687200:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783137746.687292:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7797:1869755322487424:0@lo:502: 00000040:00080000:0.0:1783137746.687322:0:7797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783137746.687521:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783137746.687971:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783137746.687986:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.688000:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137746.688011:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783137746.688014:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5dd09a3000 from 5 10000000:01000000:2.0:1783137746.688018:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137746.688062:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.688070:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.688080:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.688100:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487552:0@lo:101: 00000100:00100000:2.0:1783137746.688152:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.688177:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc3948840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.688233:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487552 00000100:00100000:0.0:1783137746.688239:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487552 00000100:00100000:0.0:1783137746.688285:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783137746.688294:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322487552:12345-0@lo:101: 00010000:00010000:0.0:1783137746.688307:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137746.688324:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f5d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.688351:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f5d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.688363:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f5d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.688373:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030800, rc 0) 00000100:00100000:0.0:1783137746.688409:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322487552:12345-0@lo:101: Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.688416:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783137746.688498:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487552:0@lo:101: 00010000:00010000:2.0:1783137746.688524:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.688534:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.688618:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487680:0@lo:256: 00000100:00100000:2.0:1783137746.688654:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.688674:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc3948840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.688724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487680 00000100:00100000:0.0:1783137746.688728:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487680 00000100:00100000:0.0:1783137746.688757:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783137746.688764:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322487680:12345-0@lo:256: 20000000:01000000:0.0:1783137746.688779:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783137746.688799:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783137746.688802:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783137746.688879:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322487680:12345-0@lo:256: Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.688886:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783137746.688957:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487680:0@lo:256: 10000000:01000000:2.0:1783137746.689005:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783137746.689012:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.689019:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137746.689027:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783137746.689029:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783137746.689032:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783137746.689049:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.689056:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.689073:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.689086:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487808:0@lo:101: 00000100:00100000:2.0:1783137746.689112:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.689166:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.689661:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487808 00000100:00100000:0.0:1783137746.689668:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487808 00000100:00100000:0.0:1783137746.689708:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783137746.689716:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322487808:12345-0@lo:101: 00010000:00010000:0.0:1783137746.689725:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137746.689739:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f6b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.689761:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.689770:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137746.689778:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031c00, rc 0) 00000100:00100000:0.0:1783137746.689811:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322487808:12345-0@lo:101: Request processed in 96us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.689818:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783137746.689890:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487808:0@lo:101: 00010000:00010000:2.0:1783137746.689903:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137746.689912:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137746.689969:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487936:0@lo:501: 00000100:00100000:2.0:1783137746.689995:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137746.690028:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c63480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137746.690100:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322487936 00000100:00100000:0.0:1783137746.690104:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322487936 00000100:00100000:0.0:1783137746.690131:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783137746.690138:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322487936:12345-0@lo:501: 00000100:00100000:0.0:1783137746.690450:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322487936:12345-0@lo:501: Request processed in 310us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.690457:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783137746.690589:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322487936:0@lo:501: 00000100:00100000:3.0:1783137746.690634:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322488064:0@lo:503: 00000100:00100000:3.0:1783137746.690679:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.690697:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.690750:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488064 00000100:00100000:2.0:1783137746.690755:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488064 00000100:00100000:2.0:1783137746.690785:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783137746.690791:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322488064:12345-0@lo:503: 00000100:00100000:2.0:1783137746.691131:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322488064:12345-0@lo:503: Request processed in 339us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.691138:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783137746.691217:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322488064:0@lo:503: 00000100:00100000:3.0:1783137746.694754:0:7798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7798:1869755322488192:0@lo:502: 00000100:00100000:3.0:1783137746.694875:0:7798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.694926:0:7798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137746.696216:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488192 00000100:00100000:2.0:1783137746.696232:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488192 00000100:00100000:2.0:1783137746.696356:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783137746.696374:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:7798:x1869755322488192:12345-0@lo:502: 00000100:00100000:2.0:1783137746.696877:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:7798:x1869755322488192:12345-0@lo:502: Request processed in 507us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137746.696888:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783137746.697007:0:7798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7798:1869755322488192:0@lo:502: 00000020:01000000:1.0:1783137746.697060:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783137746.697072:0:7798:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783137746.697082:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137746.697084:0:7798:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783137746.697091:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783137746.697095:0:7798:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:1.0:1783137746.697124:0:7798:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783137746.697127:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137746.697150:0:7798:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5df5e48000) 00000020:00000080:1.0:1783137746.697178:0:7798:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783137746.697183:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783137746.697283:0:7798:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783137746.697291:0:7798:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783137746.697304:0:7798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b6f80 00010000:00080000:1.0:1783137746.697341:0:7798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dc5c05800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1783137746.697656:0:7798:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783137746.698033:0:7798:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783137746.698049:0:7798:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783137746.698736:0:7798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137746.698990:0:7798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137746.699050:0:7798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783137746.699116:0:7798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1783137746.706300:0:7799:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137746.706313:0:7799:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783137746.711291:0:7798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137746.711313:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783137746.711365:0:7798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783137746.711399:0:7798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b6f87 00000100:00080000:3.0:1783137746.711415:0:7798:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783137746.711831:0:7798:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5c05800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783137746.711882:0:7798:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5dc4205f80 x1869755322488320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137746.711917:0:7798:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783137746.712003:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137746.712009:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137746.712011:0:7798:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783137746.712014:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137746.712029:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137746.712031:0:7798:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783137746.712034:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783137746.712035:0:7798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783137746.712070:0:7798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7798:1869755322488448:0@lo:502: 00000100:00100000:0.0:1783137746.712084:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322488320:0@lo:8: 00000100:00100000:1.0:1783137746.712224:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322488576:0@lo:400: 00000100:00100000:3.0:1783137746.712295:0:7798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.712329:0:7798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137746.712350:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488448 00000100:00100000:3.0:1783137746.712357:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488448 00000100:00100000:3.0:1783137746.712407:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783137746.712423:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:7798:x1869755322488448:12345-0@lo:502: 00000100:00100000:3.0:1783137746.712764:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:7798:x1869755322488448:12345-0@lo:502: Request processed in 347us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.712772:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783137746.712848:0:7798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:7798:1869755322488448:0@lo:502: 00000020:01000000:3.0:1783137746.712886:0:7798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1783137746.712888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783137746.712895:0:7798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137746.712898:0:7798:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783137746.712906:0:7798:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1783137746.712971:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488320 00000100:00100000:0.0:1783137746.712980:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488320 00000100:00100000:0.0:1783137746.713016:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137746.713024:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322488320:12345-0@lo:8: 00010000:00080000:0.0:1783137746.713055:0:6616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:01000000:3.0:1783137746.713078:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783137746.713110:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783137746.713123:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713135:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137746.713148:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783137746.713151:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5dc5dd19c0 from 1 10000000:01000000:3.0:1783137746.713160:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783137746.713193:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713203:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713214:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783137746.713227:0:6616:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b6f8e 00000100:00100000:3.0:1783137746.713234:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322489088:0@lo:101: 00002000:00100000:0.0:1783137746.713246:0:6616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e5dfb0d7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783137746.713253:0:6616:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1783137746.713257:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783137746.713277:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.713299:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137746.713324:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489088 00000100:00100000:3.0:1783137746.713329:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489088 00000100:00100000:3.0:1783137746.713366:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783137746.713377:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322489088:12345-0@lo:101: 00010000:00010000:3.0:1783137746.713389:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1783137746.713401:0:6616:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:3.0:1783137746.713405:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6f95 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713433:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713446:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713457:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d8000, rc 0) 00000100:00100000:3.0:1783137746.713493:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322489088:12345-0@lo:101: Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.713521:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783137746.713579:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322489088:0@lo:101: 00010000:00010000:3.0:1783137746.713593:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.713602:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137746.713649:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322489216:0@lo:501: 00000100:00100000:3.0:1783137746.713674:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.713686:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2a88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137746.713698:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489216 00000100:00100000:3.0:1783137746.713701:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489216 00000100:00100000:3.0:1783137746.713720:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783137746.713727:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322489216:12345-0@lo:501: 00000100:00100000:3.0:1783137746.713966:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322489216:12345-0@lo:501: Request processed in 238us (290us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137746.713973:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783137746.714002:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322489216:0@lo:501: 10000000:01000000:3.0:1783137746.714020:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783137746.714027:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137746.714035:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137746.714216:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.714246:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137746.714255:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322488960:0@lo:400: 00000100:00100000:1.0:1783137746.714310:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.714347:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322488704:0@lo:400: 00000100:00100000:1.0:1783137746.714375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.714394:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137746.714401:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322488832:0@lo:400: 00000100:00100000:1.0:1783137746.714427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.714461:0:6617:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137746.714471:0:6617:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783137746.714505:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488576 00000100:00100000:1.0:1783137746.714648:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488576 00000100:00100000:1.0:1783137746.714723:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488960 00000100:00100000:1.0:1783137746.714727:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488960 00000100:00100000:3.0:1783137746.714763:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488704 00000100:00100000:3.0:1783137746.714772:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488704 00000100:00100000:3.0:1783137746.714791:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137746.714798:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322488576:12345-0@lo:400: 00000100:00100000:3.0:1783137746.714843:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322488576:12345-0@lo:400: Request processed in 45us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.714850:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137746.714864:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137746.714870:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322488960:12345-0@lo:400: 00000100:00100000:3.0:1783137746.714896:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322488960:12345-0@lo:400: Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.714901:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137746.714912:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137746.714917:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322488704:12345-0@lo:400: 00000100:00100000:3.0:1783137746.714947:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322488704:12345-0@lo:400: Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.714953:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137746.715064:0:6615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137746.715072:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322488832 00000100:00100000:1.0:1783137746.715075:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322488832 00000100:00100000:1.0:1783137746.715102:0:6615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137746.715108:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137746.715115:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322488832:12345-0@lo:400: 00000100:00100000:1.0:1783137746.715147:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322488832:12345-0@lo:400: Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.715152:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783137746.715317:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7e300 x1869755322488960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.715331:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322488960:0@lo:400: 00010000:00080000:1.0:1783137746.715344:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7f100 x1869755322488576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.715354:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322488576:0@lo:400: 00010000:00080000:1.0:1783137746.715388:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7d500 x1869755322488832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.715397:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322488832:0@lo:400: 00010000:00080000:1.0:1783137746.715407:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7ea00 x1869755322488704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.715414:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322488704:0@lo:400: 00000100:00080000:1.0:1783137746.715432:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1783137746.716119:0:6616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783137746.716273:0:6616:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137746.716381:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1869755322488320:12345-0@lo:8: Request processed in 3355us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.716397:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783137746.716455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc4205f80 x1869755322488320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.716470:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783137746.716490:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783137746.716503:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783137746.716523:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783137746.716528:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5c05800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783137746.716572:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783137746.716580:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322488320:0@lo:8: 00000004:00080000:0.0:1783137746.717024:0:7799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783137746.717437:0:7799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 236609891191ns, next at 0ns, rc = 0 00000004:00080000:3.0:1783137746.776369:0:7800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783137746.776405:0:7800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489472:0@lo:7: 00000100:00100000:3.0:1783137746.776501:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.776578:0:7800:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd09bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.776854:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322489344:0@lo:13: 00000100:00100000:1.0:1783137746.776888:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.776929:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489472 00000100:00100000:1.0:1783137746.776937:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489472 00000100:00100000:1.0:1783137746.776991:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137746.777001:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7800:x1869755322489472:12345-0@lo:7: 00000100:00100000:3.0:1783137746.777715:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489344 00000100:00100000:3.0:1783137746.777722:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489344 00000100:00100000:3.0:1783137746.777758:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137746.777766:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322489344:12345-0@lo:13: 00002000:00000024:3.0:1783137746.777794:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1783137746.777853:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322489344:12345-0@lo:13: Request processed in 87us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137746.777867:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783137746.781700:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783137746.783862:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc4206d80 x1869755322489344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137746.783891:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322489344:0@lo:13: 00002000:00080000:1.0:1783137746.789954:0:6615:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1783137746.789964:0:6615:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783137746.790314:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7800:x1869755322489472:12345-0@lo:7: Request processed in 13309us (13808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137746.790325:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783137746.790390:0:7800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc4205f80 x1869755322489472/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783137762 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.790405:0:7800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489472:0@lo:7: 00000004:00080000:1.0:1783137746.790419:0:7800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783137746.790471:0:7800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489600:0@lo:5: 00000100:00100000:1.0:1783137746.790519:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.790578:0:7800:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e0133ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137746.790604:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489600 00000100:00100000:1.0:1783137746.790690:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489600 00000100:00100000:1.0:1783137746.790742:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137746.790765:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7800:x1869755322489600:12345-0@lo:5: 00002000:00080000:1.0:1783137746.790793:0:7801:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783137746.790797:0:7801:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783137746.791748:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7800:x1869755322489600:12345-0@lo:5: Request processed in 982us (1237us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783137746.791757:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783137746.791813:0:7800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216ed80 x1869755322489600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137762 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137746.791827:0:7800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489600:0@lo:5: 00000004:00080000:1.0:1783137746.791839:0:7800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783137746.791870:0:7800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489728:0@lo:700: 00000100:00100000:1.0:1783137746.792032:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137746.792131:0:7800:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01104000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137746.794684:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489728 00000100:00100000:3.0:1783137746.794698:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489728 00000100:00100000:3.0:1783137746.794786:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137746.794796:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7800:x1869755322489728:12345-0@lo:700: 00000100:00100000:3.0:1783137746.794860:0:6623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6623:1869755322489856:0@lo:700: 00000100:00100000:3.0:1783137746.794927:0:6623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137746.794962:0:6623:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd09bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137746.794983:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489856 00000100:00100000:3.0:1783137746.794986:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489856 00000100:00100000:3.0:1783137746.795027:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137746.795037:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6623:x1869755322489856:12345-0@lo:700: 00000100:00100000:2.0:1783137746.795042:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:2.0:1783137746.795062:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 00000004:00080000:1.0:1783137746.869790:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1783137746.945476:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1783137746.956780:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6623:x1869755322489856:12345-0@lo:700: Request processed in 161731us (161838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137746.956801:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783137746.965972:0:6623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c0700 x1869755322489856/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783137762 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137746.965998:0:6623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6623:1869755322489856:0@lo:700: 40000000:02000000:2.0:1783137746.966017:0:6623:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1783137747.118240:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7800:x1869755322489728:12345-0@lo:700: Request processed in 323435us (326217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137747.118259:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783137747.118296:0:7800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216e680 x1869755322489728/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783137762 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137747.118312:0:7800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489728:0@lo:700: 00000001:00100000:1.0:1783137747.118595:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783137747.118625:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:3.0:1783137747.203026:0:7800:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1783137747.224662:0:7800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489984:0@lo:5: 00000100:00100000:0.0:1783137747.230612:0:7800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137747.230709:0:7800:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137747.230965:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322489984 00000100:00100000:2.0:1783137747.230982:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322489984 00000100:00100000:2.0:1783137747.231067:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137747.231081:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7800:x1869755322489984:12345-0@lo:5: 00002000:00080000:2.0:1783137747.236431:0:6617:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783137747.236459:0:6617:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783137747.242890:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7800:x1869755322489984:12345-0@lo:5: Request processed in 11796us (12269us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783137747.242910:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783137747.243074:0:7800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f8b480 x1869755322489984/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137763 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137747.243091:0:7800:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783137747.243321:0:7800:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5df5f8b480 x1869755322489984/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137763 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137747.243338:0:7800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7800:1869755322489984:0@lo:5: 00000004:00080000:0.0:1783137747.243358:0:7800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1783137747.450890:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137748.274765:0:7871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783137748.476210:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137749.498856:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137749.693687:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322490112:0@lo:13: 00000100:00100000:3.0:1783137749.693761:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137749.693838:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490112 00000100:00100000:3.0:1783137749.693846:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490112 00000100:00100000:3.0:1783137749.693901:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137749.693911:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322490112:12345-0@lo:13: 00002000:00000024:3.0:1783137749.693946:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137749.693991:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322490112:12345-0@lo:13: Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137749.694008:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783137749.694030:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783137749.694059:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c3800 x1869755322490112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137749.694077:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322490112:0@lo:13: 00010000:00010000:0.0:1783137750.522794:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137751.552337:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137751.740333:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322490240:0@lo:400: 00000100:00100000:3.0:1783137751.740404:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137751.742578:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490240 00000100:00100000:0.0:1783137751.742593:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490240 00000100:00100000:0.0:1783137751.742649:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783137751.742659:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322490240:12345-0@lo:400: 00000100:00100000:0.0:1783137751.745892:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322490240:12345-0@lo:400: Request processed in 3224us (5476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137751.745908:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783137751.750018:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322490368:0@lo:400: 00000100:00100000:0.0:1783137751.750106:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137751.750160:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137751.750168:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322490496:0@lo:400: 00000100:00100000:0.0:1783137751.750191:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137751.750240:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322490624:0@lo:400: 00000100:00100000:0.0:1783137751.750270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137751.750306:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490368 00000100:00100000:0.0:1783137751.750313:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490368 00000100:00100000:0.0:1783137751.750354:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490496 00000100:00100000:0.0:1783137751.750357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490496 00000100:00100000:0.0:1783137751.750387:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783137751.750396:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322490368:12345-0@lo:400: 00000100:00100000:0.0:1783137751.750449:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322490368:12345-0@lo:400: Request processed in 54us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137751.750455:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783137751.750483:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137751.750490:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322490496:12345-0@lo:400: 00000100:00100000:0.0:1783137751.750517:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322490496:12345-0@lo:400: Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137751.750522:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137751.750539:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490624 00000100:00100000:0.0:1783137751.750565:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490624 00000100:00100000:0.0:1783137751.750593:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137751.750599:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322490624:12345-0@lo:400: 00000100:00100000:0.0:1783137751.750631:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322490624:12345-0@lo:400: Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137751.750637:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783137751.750699:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110f800 x1869755322490624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137751.750711:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322490624:0@lo:400: 00010000:00080000:0.0:1783137751.750734:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110df80 x1869755322490496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137751.750749:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322490496:0@lo:400: 00010000:00080000:0.0:1783137751.750759:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110f100 x1869755322490368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137751.750766:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322490368:0@lo:400: 00000100:00100000:2.0:1783137751.753824:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322490880:0@lo:400: 00000100:00100000:2.0:1783137751.753896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137751.753957:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490880 00000100:00100000:2.0:1783137751.753964:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490880 00000100:00100000:2.0:1783137751.754024:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137751.754032:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322490880:12345-0@lo:400: 00000100:00100000:2.0:1783137751.754083:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322490880:12345-0@lo:400: Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137751.754090:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783137751.754132:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110ca80 x1869755322490880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137751.754145:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322490880:0@lo:400: 00000100:00080000:2.0:1783137751.754206:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137751.754211:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137751.754214:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137751.754487:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137751.754500:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322490752:0@lo:400: 00000100:00100000:0.0:1783137751.754533:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137751.754768:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322490752 00000100:00100000:2.0:1783137751.754773:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322490752 00000100:00100000:2.0:1783137751.754813:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783137751.754820:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322490752:12345-0@lo:400: 00000100:00100000:2.0:1783137751.754857:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322490752:12345-0@lo:400: Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137751.754863:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1783137751.754911:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137751.754947:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110c700 x1869755322490752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137751.754958:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322490752:0@lo:400: 00000100:00100000:3.0:1783137751.756051:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322490240:0@lo:400: 00000100:00100000:3.0:1783137752.251487:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137752.251512:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322491008:0@lo:13: 00000100:00100000:3.0:1783137752.251599:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137752.251861:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491008 00000100:00100000:2.0:1783137752.251870:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491008 00000100:00100000:2.0:1783137752.251957:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137752.251969:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322491008:12345-0@lo:13: 00002000:00000024:2.0:1783137752.252017:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137752.252068:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322491008:12345-0@lo:13: Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137752.252075:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783137752.252140:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c3800 x1869755322491008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137752.252160:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322491008:0@lo:13: 00000001:00080000:0.0:1783137752.393679:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1783137752.572012:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137753.595169:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137754.619298:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137754.811108:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137754.811157:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322491136:0@lo:13: 00000100:00100000:2.0:1783137754.811257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137754.811461:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491136 00000100:00100000:3.0:1783137754.811472:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491136 00000100:00080000:2.0:1783137754.811639:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137754.814133:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137754.814227:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322491136:12345-0@lo:13: 00002000:00000024:3.0:1783137754.814290:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137754.814418:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322491136:12345-0@lo:13: Request processed in 270us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137754.814428:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783137754.815000:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c3800 x1869755322491136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137754.815028:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322491136:0@lo:13: 00000100:00100000:2.0:1783137755.554384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.554644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398016 00000100:00100000:3.0:1783137755.554659:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398016 00000100:00100000:3.0:1783137755.554721:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:3.0:1783137755.554733:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1869755299398016:12345-192.168.202.24@tcp:250: 00010000:00080000:3.0:1783137755.554959:0:5806:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 485cbb35-9a21-40da-aa4c-96c55de41b69@192.168.202.24@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1783137755.554994:0:5806:0:(genops.c:1406:class_connect()) connect: client 485cbb35-9a21-40da-aa4c-96c55de41b69, cookie 0x4691dfc3d66b6fa3 00000100:00080000:3.0:1783137755.555126:0:5806:0:(import.c:65:import_set_state_nolock()) ffff8e5dfa508000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137755.555230:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+5:2349:x1869755299398016:12345-192.168.202.24@tcp:250: Request processed in 498us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.555237:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:2.0:1783137755.557360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.557471:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299397888 00000100:00100000:3.0:1783137755.557481:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299397888 00000100:00100000:3.0:1783137755.560488:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:3.0:1783137755.560526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+5:5568:x1869755299397888:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1783137755.560622:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137755.560649:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922477 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.560692:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.560703:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.560712:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9000, rc 0) 00000100:00100000:3.0:1783137755.560916:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+6:5568:x1869755299397888:12345-192.168.202.24@tcp:101: Request processed in 408us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.560948:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:1.0:1783137755.577703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.578259:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398144 00000100:00100000:3.0:1783137755.578271:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398144 00000100:00100000:3.0:1783137755.578336:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:3.0:1783137755.578346:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+6:5568:x1869755299398144:12345-192.168.202.24@tcp:501: 00000100:00100000:3.0:1783137755.578916:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+6:5568:x1869755299398144:12345-192.168.202.24@tcp:501: Request processed in 566us (1225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137755.578927:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:2.0:1783137755.588766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.588880:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398272 00000100:00100000:3.0:1783137755.588894:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398272 00000100:00100000:3.0:1783137755.588962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:3.0:1783137755.588973:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+6:5568:x1869755299398272:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1783137755.588995:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137755.589021:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392247e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.589062:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.589076:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.589087:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9400, rc 0) 00000100:00100000:3.0:1783137755.589176:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+7:5568:x1869755299398272:12345-192.168.202.24@tcp:101: Request processed in 204us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.589184:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:2.0:1783137755.594310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.594499:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398400 00000100:00100000:3.0:1783137755.594532:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398400 00000100:00100000:3.0:1783137755.594651:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:3.0:1783137755.594664:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+7:5568:x1869755299398400:12345-192.168.202.24@tcp:501: 00000100:00100000:3.0:1783137755.595107:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5568:x1869755299398400:12345-192.168.202.24@tcp:501: Request processed in 443us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.595117:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:2.0:1783137755.599348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137755.599714:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398528 00000100:00100000:1.0:1783137755.599729:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398528 00000100:00100000:1.0:1783137755.599799:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:1.0:1783137755.599811:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5568:x1869755299398528:12345-192.168.202.24@tcp:503: 00000100:00100000:1.0:1783137755.600642:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5568:x1869755299398528:12345-192.168.202.24@tcp:503: Request processed in 827us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137755.600653:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1783137755.606750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137755.606945:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398656 00000100:00100000:2.0:1783137755.606960:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398656 00000100:00100000:2.0:1783137755.607038:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:2.0:1783137755.607051:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5586:x1869755299398656:12345-192.168.202.24@tcp:502: 00000100:00100000:2.0:1783137755.607513:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5586:x1869755299398656:12345-192.168.202.24@tcp:502: Request processed in 463us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137755.607523:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00010000:00010000:0.0:1783137755.642905:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137755.644988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137755.645112:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398784 00000100:00100000:1.0:1783137755.645143:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398784 00000100:00100000:2.0:1783137755.645361:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:2.0:1783137755.645377:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5586:x1869755299398784:12345-192.168.202.24@tcp:502: 00000100:00100000:2.0:1783137755.646421:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5586:x1869755299398784:12345-192.168.202.24@tcp:502: Request processed in 1037us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137755.646442:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:1.0:1783137755.650747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.651430:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299398912 00000100:00100000:3.0:1783137755.651458:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299398912 00000100:00100000:3.0:1783137755.651594:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:3.0:1783137755.651609:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5568:x1869755299398912:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1783137755.651633:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137755.651690:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b6fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224a8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.651731:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b6fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224a8 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.651744:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b6fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224a8 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.651756:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7200, rc 0) 00000100:00100000:3.0:1783137755.651842:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5568:x1869755299398912:12345-192.168.202.24@tcp:101: Request processed in 236us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.651850:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:0.0:1783137755.658771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137755.658890:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399040 00000100:00100000:1.0:1783137755.658902:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399040 00000100:00100000:1.0:1783137755.658973:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:1.0:1783137755.658986:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5568:x1869755299399040:12345-192.168.202.24@tcp:256: 20000000:01000000:1.0:1783137755.659022:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783137755.659057:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783137755.659062:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783137755.659066:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783137755.659068:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783137755.670154:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5568:x1869755299399040:12345-192.168.202.24@tcp:256: Request processed in 11151us (11381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137755.670175:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:2.0:1783137755.688597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.688986:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399168 00000100:00100000:3.0:1783137755.689002:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399168 00000100:00100000:3.0:1783137755.689080:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:3.0:1783137755.689092:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5568:x1869755299399168:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1783137755.689135:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137755.689157:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224af expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.689999:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.690017:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137755.690029:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6e00, rc 0) 00000100:00100000:3.0:1783137755.690112:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5568:x1869755299399168:12345-192.168.202.24@tcp:101: Request processed in 1021us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137755.690122:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:0.0:1783137755.697335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137755.697450:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399296 00000100:00100000:1.0:1783137755.697464:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399296 00000100:00100000:1.0:1783137755.697535:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:1.0:1783137755.697591:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5568:x1869755299399296:12345-192.168.202.24@tcp:501: 00000100:00100000:1.0:1783137755.698014:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5568:x1869755299399296:12345-192.168.202.24@tcp:501: Request processed in 466us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137755.698023:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1783137755.701462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137755.701686:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399424 00000100:00100000:3.0:1783137755.701700:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399424 00000100:00100000:3.0:1783137755.702147:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:3.0:1783137755.702163:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5568:x1869755299399424:12345-192.168.202.24@tcp:503: 00000100:00100000:2.0:1783137755.707461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5568:x1869755299399424:12345-192.168.202.24@tcp:503: Request processed in 5275us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137755.707481:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:2.0:1783137755.718333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137755.718592:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399552 00000100:00100000:0.0:1783137755.718607:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399552 00000100:00100000:0.0:1783137755.718673:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:0.0:1783137755.718684:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5590:x1869755299399552:12345-192.168.202.24@tcp:502: 00000100:00100000:0.0:1783137755.719451:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5590:x1869755299399552:12345-192.168.202.24@tcp:502: Request processed in 751us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137755.719476:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:0.0:1783137755.724668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137755.724902:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399680 00000100:00100000:2.0:1783137755.724915:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399680 00000100:00100000:2.0:1783137755.724987:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1783137755.724999:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5590:x1869755299399680:12345-192.168.202.24@tcp:502: 00000100:00100000:2.0:1783137755.725487:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5590:x1869755299399680:12345-192.168.202.24@tcp:502: Request processed in 487us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137755.725497:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1783137755.730806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137755.730993:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399808 00000100:00100000:0.0:1783137755.731008:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399808 00000100:00100000:0.0:1783137755.731266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1783137755.731278:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1869755299399808:12345-192.168.202.24@tcp:38: 00010000:00080000:0.0:1783137755.731320:0:5811:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1783137755.731384:0:5811:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b6fc6 00000004:00100000:0.0:1783137755.731426:0:5811:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1783137755.731444:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1783137755.815869:0:5811:0:(import.c:65:import_set_state_nolock()) ffff8e5dc6022000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137755.816043:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299399808:12345-192.168.202.24@tcp:38: Request processed in 84764us (85253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137755.816296:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00010000:00010000:0.0:1783137756.668687:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137756.838319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137756.840986:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400064 00000100:00100000:0.0:1783137756.841008:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400064 00000100:00100000:0.0:1783137756.841135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1783137756.841149:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400064:12345-192.168.202.24@tcp:41: 00000004:00000024:0.0:1783137756.841220:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783137756.841326:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400064:12345-192.168.202.24@tcp:41: Request processed in 180us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137756.841334:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00080000:2.0:1783137756.842497:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137756.847282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137756.847405:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299399936 00000100:00100000:2.0:1783137756.847418:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299399936 00000100:00100000:2.0:1783137756.847503:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1783137756.847516:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:0:x1869755299399936:12345-192.168.202.24@tcp:41: 00000004:00000024:2.0:1783137756.847963:0:7189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783137756.848063:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:0:x1869755299399936:12345-192.168.202.24@tcp:41: Request processed in 549us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137756.848071:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1783137756.850843:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137756.850985:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400192 00000100:00100000:0.0:1783137756.850997:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400192 00000100:00100000:0.0:1783137756.851078:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1783137756.851091:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400192:12345-192.168.202.24@tcp:40: 00000100:00100000:0.0:1783137756.851226:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400192:12345-192.168.202.24@tcp:40: Request processed in 137us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137756.851255:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1783137756.854624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137756.854737:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400576 00000100:00100000:3.0:1783137756.854751:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400576 00000100:00100000:3.0:1783137756.854824:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783137756.854837:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400576:12345-192.168.202.24@tcp:33: 00000100:00100000:3.0:1783137756.855700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137756.855733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137756.855964:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400320 00000100:00100000:1.0:1783137756.855971:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400320 00000100:00100000:1.0:1783137756.856014:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400448 00000100:00100000:1.0:1783137756.856016:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400448 00000100:00100000:1.0:1783137756.856035:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1783137756.856043:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1869755299400320:12345-192.168.202.24@tcp:8: 00010000:00080000:1.0:1783137756.856091:0:7801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1783137756.856125:0:7801:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b6fcd 00002000:00100000:1.0:1783137756.856139:0:7801:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75742c0b-74ec-412f-af86-0dbffc92280b/ffff8e5dffbcc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783137756.856168:0:7801:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783137756.856623:0:7801:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783137756.856659:0:7801:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783137756.856738:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299400320:12345-192.168.202.24@tcp:8: Request processed in 695us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137756.856747:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1783137756.856770:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1783137756.856775:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1869755299400448:12345-192.168.202.24@tcp:8: 00010000:00080000:1.0:1783137756.856794:0:7801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1783137756.856812:0:7801:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b6fd4 00002000:00100000:1.0:1783137756.856818:0:7801:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75742c0b-74ec-412f-af86-0dbffc92280b/ffff8e5dffbce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783137756.856836:0:7801:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783137756.857036:0:7801:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783137756.857050:0:7801:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783137756.857072:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299400448:12345-192.168.202.24@tcp:8: Request processed in 295us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137756.857079:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783137756.861310:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322491392:0@lo:400: 00000100:00100000:3.0:1783137756.861413:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137756.861498:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322491904:0@lo:400: 00000100:00100000:3.0:1783137756.861530:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137756.861600:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137756.861607:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322491520:0@lo:400: 00000100:00100000:3.0:1783137756.861633:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137756.861670:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491392 00000100:00100000:3.0:1783137756.861680:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491392 00000100:00100000:3.0:1783137756.861734:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491520 00000100:00100000:3.0:1783137756.861738:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491520 00000100:00100000:3.0:1783137756.861774:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783137756.861785:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322491392:12345-0@lo:400: 00000100:00100000:3.0:1783137756.861847:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322491392:12345-0@lo:400: Request processed in 63us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137756.861855:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783137756.861873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137756.861879:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322491520:12345-0@lo:400: 00000100:00100000:3.0:1783137756.861907:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322491520:12345-0@lo:400: Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137756.861913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783137756.861953:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c2d80 x1869755322491520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137756.861971:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322491520:0@lo:400: 00010000:00080000:3.0:1783137756.861984:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c2300 x1869755322491392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137756.861999:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322491392:0@lo:400: 00000100:00100000:3.0:1783137756.862033:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491904 00000100:00100000:3.0:1783137756.862044:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491904 00000100:00100000:3.0:1783137756.862079:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137756.862086:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322491904:12345-0@lo:400: 00000100:00100000:3.0:1783137756.862123:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322491904:12345-0@lo:400: Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137756.862129:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783137756.862153:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c0000 x1869755322491904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137756.862160:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783137756.862172:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322491904:0@lo:400: 00000100:00100000:0.0:1783137756.862443:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322491648:0@lo:400: 00000100:00100000:0.0:1783137756.862482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137756.862512:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137756.862518:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322491264:0@lo:400: 00000100:00100000:0.0:1783137756.862573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137756.862599:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322491776:0@lo:400: 00000100:00100000:0.0:1783137756.862623:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137756.862742:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491264 00000100:00100000:1.0:1783137756.862747:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491264 00000100:00100000:1.0:1783137756.862782:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783137756.862789:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322491264:12345-0@lo:400: 00000100:00100000:1.0:1783137756.862844:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322491264:12345-0@lo:400: Request processed in 55us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137756.862850:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783137756.862888:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322491264:0@lo:400: 00000100:00100000:3.0:1783137756.868736:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491776 00000100:00100000:3.0:1783137756.868757:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491776 00000100:00100000:3.0:1783137756.868852:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137756.868866:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322491776:12345-0@lo:400: 00000100:00080000:2.0:1783137756.868911:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137756.868918:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137756.868980:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322491648 00000100:00100000:2.0:1783137756.868985:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322491648 00000100:00100000:3.0:1783137756.868998:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322491776:12345-0@lo:400: Request processed in 136us (6374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137756.869006:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783137756.869024:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137756.869031:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322491648:12345-0@lo:400: 00010000:00080000:3.0:1783137756.869064:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c2680 x1869755322491776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137756.869083:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322491776:0@lo:400: 00000100:00100000:2.0:1783137756.869104:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322491648:12345-0@lo:400: Request processed in 75us (6622us total) trans 0 rc 0/0 00010000:00080000:3.0:1783137756.869111:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c1c00 x1869755322491648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137756.869111:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137756.869120:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322491648:0@lo:400: 00000100:00080000:2.0:1783137756.869130:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137756.869600:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137756.869645:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400704 00000100:00100000:3.0:1783137756.869656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400704 00000100:00100000:3.0:1783137756.869696:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:3.0:1783137756.869712:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299400704:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1783137756.869818:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299400704:12345-192.168.202.24@tcp:400: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137756.869825:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000004:00080000:3.0:1783137756.892198:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37270us 00000004:00200000:2.0:1783137756.919138:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783137756.919352:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:5568:x1869755299400576:12345-192.168.202.24@tcp:33: Request processed in 64509us (64737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137756.919372:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1783137757.109927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137757.110044:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400832 00000100:00100000:3.0:1783137757.110059:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400832 00000100:00100000:3.0:1783137757.110139:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1783137757.110152:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:5608:x1869755299400832:12345-192.168.202.24@tcp:101: 00010000:00010000:3.0:1783137757.110183:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137757.111786:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b6fdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224d9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112030:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112044:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112059:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137757.112275:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783137757.112279:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137757.112359:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112487:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b6fdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224d9 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112522:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224d9 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137757.112531:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2a00) 00010000:00010000:3.0:1783137757.112535:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137757.112539:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783137757.112680:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:5608:x1869755299400832:12345-192.168.202.24@tcp:101: Request processed in 2529us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137757.112689:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1783137757.370898:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137757.370925:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322492032:0@lo:13: 00000100:00100000:0.0:1783137757.371010:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137757.371051:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492032 00000100:00100000:1.0:1783137757.371060:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492032 00000100:00100000:1.0:1783137757.371118:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783137757.371128:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322492032:12345-0@lo:13: 00002000:00000024:1.0:1783137757.371154:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137757.371214:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322492032:12345-0@lo:13: Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137757.371221:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783137757.371360:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c1c00 x1869755322492032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137757.371378:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322492032:0@lo:13: 00010000:00010000:1.0:1783137757.690936:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137758.714921:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137759.254485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137759.254671:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299400960 00000100:00100000:3.0:1783137759.254685:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299400960 00000100:00100000:3.0:1783137759.254779:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783137759.254793:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:5660:x1869755299400960:12345-192.168.202.24@tcp:41: 00000004:00000024:3.0:1783137759.254858:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783137759.254948:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:5660:x1869755299400960:12345-192.168.202.24@tcp:41: Request processed in 159us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137759.254957:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00080000:2.0:1783137759.255087:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137759.262703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137759.262951:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401088 00000100:00100000:1.0:1783137759.262962:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401088 00000100:00100000:1.0:1783137759.263126:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1783137759.263139:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75742c0b-74ec-412f-af86-0dbffc92280b+6:5660:x1869755299401088:12345-192.168.202.24@tcp:13: 00002000:00000024:1.0:1783137759.263197:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137759.263297:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75742c0b-74ec-412f-af86-0dbffc92280b+6:5660:x1869755299401088:12345-192.168.202.24@tcp:13: Request processed in 160us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137759.263306:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00080000:2.0:1783137759.265197:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137759.265355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137759.265452:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401216 00000100:00100000:1.0:1783137759.265461:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401216 00000100:00100000:1.0:1783137759.265536:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:1.0:1783137759.265564:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75742c0b-74ec-412f-af86-0dbffc92280b+6:5660:x1869755299401216:12345-192.168.202.24@tcp:13: 00002000:00000024:1.0:1783137759.265607:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137759.265685:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75742c0b-74ec-412f-af86-0dbffc92280b+6:5660:x1869755299401216:12345-192.168.202.24@tcp:13: Request processed in 138us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137759.265692:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00080000:2.0:1783137759.266196:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783137759.738865:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137759.930813:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137759.930851:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322492160:0@lo:13: 00000100:00100000:2.0:1783137759.930947:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137759.931147:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492160 00000100:00100000:3.0:1783137759.931158:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492160 00000100:00100000:3.0:1783137759.931247:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137759.931258:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322492160:12345-0@lo:13: 00002000:00000024:3.0:1783137759.931290:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137759.931359:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322492160:12345-0@lo:13: Request processed in 91us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137759.931368:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783137759.931449:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c2680 x1869755322492160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137759.931471:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322492160:0@lo:13: 00000100:00080000:2.0:1783137759.931626:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1783137760.566908:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00010000:00010000:1.0:1783137760.762908:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137761.041905:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000001:00100000:3.0:1783137761.043791:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00010000:00010000:0.0:1783137761.789536:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137761.893449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137761.893497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137761.893531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137761.893587:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137761.893617:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401728 00000100:00100000:3.0:1783137761.893626:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401728 00000100:00100000:3.0:1783137761.893755:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401600 00000100:00100000:3.0:1783137761.893759:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401600 00000100:00100000:3.0:1783137761.893782:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1783137761.893792:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299401728:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1783137761.893868:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299401728:12345-192.168.202.24@tcp:400: Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137761.893875:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1783137761.893892:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1783137761.893899:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299401600:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1783137761.893925:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299401600:12345-192.168.202.24@tcp:400: Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137761.893931:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1783137761.894099:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401472 00000100:00100000:2.0:1783137761.894104:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401472 00000100:00100000:2.0:1783137761.894141:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1783137761.894149:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299401472:12345-192.168.202.24@tcp:400: 00000100:00100000:2.0:1783137761.894187:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299401472:12345-192.168.202.24@tcp:400: Request processed in 39us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137761.894193:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1783137761.894211:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401344 00000100:00100000:2.0:1783137761.894215:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401344 00000100:00100000:2.0:1783137761.894240:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:2.0:1783137761.894246:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2350:x1869755299401344:12345-192.168.202.24@tcp:400: 00000100:00100000:2.0:1783137761.894288:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2350:x1869755299401344:12345-192.168.202.24@tcp:400: Request processed in 41us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137761.894294:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00080000:2.0:1783137761.894320:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137761.894325:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137761.894327:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137761.982316:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322492672:0@lo:400: 00000100:00100000:0.0:1783137761.982411:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982476:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137761.982502:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322492288:0@lo:400: 00000100:00100000:0.0:1783137761.982533:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982574:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322492800:0@lo:400: 00000100:00100000:0.0:1783137761.982599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982626:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322492416:0@lo:400: 00000100:00100000:0.0:1783137761.982650:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982667:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322492928:0@lo:400: 00000100:00100000:0.0:1783137761.982690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982708:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137761.982714:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322492544:0@lo:400: 00000100:00100000:0.0:1783137761.982734:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137761.982766:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492672 00000100:00100000:0.0:1783137761.982774:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492672 00000100:00100000:0.0:1783137761.982822:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492928 00000100:00100000:0.0:1783137761.982825:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492928 00000100:00100000:0.0:1783137761.982851:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137761.982859:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322492672:12345-0@lo:400: 00000100:00100000:0.0:1783137761.982911:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322492672:12345-0@lo:400: Request processed in 53us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.982917:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137761.982933:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137761.982938:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322492928:12345-0@lo:400: 00000100:00100000:0.0:1783137761.982967:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322492928:12345-0@lo:400: Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.982972:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137761.982988:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492288 00000100:00100000:0.0:1783137761.982992:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492288 00000100:00100000:0.0:1783137761.983022:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783137761.983029:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322492288:12345-0@lo:400: 00000100:00100000:0.0:1783137761.983058:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322492288:12345-0@lo:400: Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.983064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783137761.983091:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492800 00000100:00100000:0.0:1783137761.983095:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492800 00000100:00100000:0.0:1783137761.983119:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492416 00000100:00100000:0.0:1783137761.983122:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492416 00000100:00100000:0.0:1783137761.983133:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322492544 00000100:00100000:0.0:1783137761.983135:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322492544 00000100:00100000:0.0:1783137761.983148:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137761.983154:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322492800:12345-0@lo:400: 00000100:00100000:0.0:1783137761.983184:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322492800:12345-0@lo:400: Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.983190:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137761.983199:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137761.983204:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322492416:12345-0@lo:400: 00000100:00100000:0.0:1783137761.983226:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322492416:12345-0@lo:400: Request processed in 22us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.983231:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137761.983239:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783137761.983245:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322492544:12345-0@lo:400: 00000100:00100000:0.0:1783137761.983269:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322492544:12345-0@lo:400: Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137761.983274:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783137761.983298:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137761.983309:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137761.983311:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137761.983351:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322492544:0@lo:400: 00000100:00100000:0.0:1783137761.983362:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322492416:0@lo:400: 00010000:00080000:0.0:1783137761.983373:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff97a680 x1869755322492928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137761.983397:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322492928:0@lo:400: 00000100:00100000:0.0:1783137761.983427:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322492288:0@lo:400: 00000100:00100000:0.0:1783137761.983438:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322492800:0@lo:400: 00010000:00080000:0.0:1783137761.983448:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff97ad80 x1869755322492672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137761.983456:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322492672:0@lo:400: 00000001:02000400:2.0:1783137762.200243:0:8179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783137762.491169:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322493056:0@lo:13: 00000100:00100000:0.0:1783137762.491254:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137762.491449:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493056 00000100:00100000:3.0:1783137762.491457:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493056 00000100:00100000:3.0:1783137762.491511:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137762.491575:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322493056:12345-0@lo:13: 00002000:00000024:3.0:1783137762.491622:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137762.491671:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322493056:12345-0@lo:13: Request processed in 136us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137762.491678:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783137762.492174:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c2d80 x1869755322493056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137762.492193:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322493056:0@lo:13: 00010000:00010000:0.0:1783137762.810780:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137763.838514:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137764.860603:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137765.054467:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322493184:0@lo:13: 00000100:00100000:0.0:1783137765.054582:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137765.057742:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493184 00000100:00100000:2.0:1783137765.057763:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493184 00000100:00100000:2.0:1783137765.057848:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137765.057861:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322493184:12345-0@lo:13: 00002000:00000024:2.0:1783137765.059158:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137765.059397:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322493184:12345-0@lo:13: Request processed in 1533us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137765.059409:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783137765.059456:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137765.059510:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff979c00 x1869755322493184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137765.059537:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322493184:0@lo:13: 00010000:00010000:0.0:1783137765.882831:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137766.620207:0:8329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc93a91f20 20000000:00000080:3.0:1783137766.620230:0:8329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5dfb116800 uarg=0000000000000000 20000000:01000000:3.0:1783137766.620278:0:8329:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1783137766.620281:0:8329:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1783137766.620284:0:8329:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783137766.620289:0:8329:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783137766.620296:0:8329:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1783137766.620315:0:8329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783137766.620317:0:8329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783137766.621440:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783137766.621447:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137766.622296:0:8330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1783137766.622925:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1783137766.622977:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1783137766.623005:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1783137766.623016:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783137766.623018:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137766.623884:0:8331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783137766.624888:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783137766.624980:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783137766.625019:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1783137766.625038:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783137766.625041:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137766.626129:0:8332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1783137766.626798:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1783137766.626845:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1783137766.626891:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1783137766.626907:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783137766.626910:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137766.627934:0:8333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783137766.629371:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783137766.629448:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783137766.629486:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1783137766.629506:0:8329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137766.629531:0:8329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629631:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629641:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629649:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629656:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629663:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629670:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629678:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629704:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629713:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629723:0:8329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629772:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.629791:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 9 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.629810:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493312:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137766.630006:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630016:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 9 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630025:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493440:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137766.630057:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630065:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 18 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630087:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493568:0@lo:104: 00000100:00100000:2.0:1783137766.630151:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137766.630197:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630206:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 18 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630214:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493696:0@lo:104: 00000100:00100000:2.0:1783137766.630238:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137766.630277:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630285:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 18 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630293:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493824:0@lo:104: 00010000:00010000:2.0:1783137766.630315:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630322:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 18 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630330:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493952:0@lo:104: 00010000:00010000:2.0:1783137766.630362:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630369:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 18 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630384:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494080:0@lo:104: 00010000:00010000:2.0:1783137766.630426:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630434:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 18 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630443:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494208:0@lo:104: 00010000:00010000:2.0:1783137766.630466:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.630474:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 18 pid: 5807 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.630482:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494336:0@lo:104: 00000100:00100000:2.0:1783137766.630500:0:8329:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9e71180 going to sleep for 11 seconds 00000100:00100000:0.0:1783137766.630635:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783137766.630656:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.630669:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.630677:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.630685:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.630692:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.630701:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493568 00000100:00100000:0.0:1783137766.630715:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493568 00000100:00100000:0.0:1783137766.630764:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493696 00000100:00100000:0.0:1783137766.630767:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493696 00000100:00100000:0.0:1783137766.630776:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493824 00000100:00100000:0.0:1783137766.630778:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493824 00000100:00100000:0.0:1783137766.630786:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322493952 00000100:00100000:0.0:1783137766.630788:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322493952 00000100:00100000:0.0:1783137766.630797:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494080 00000100:00100000:0.0:1783137766.630799:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494080 00000100:00100000:0.0:1783137766.630807:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494208 00000100:00100000:0.0:1783137766.630809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494208 00000100:00100000:0.0:1783137766.630817:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494336 00000100:00100000:0.0:1783137766.630819:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494336 00000100:00100000:0.0:1783137766.630832:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137766.630842:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:8329:x1869755322493568:12345-0@lo:104: 00010000:00010000:0.0:1783137766.630856:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.630930:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137766.630937:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+9:8329:x1869755322493568:12345-0@lo:104: Request processed in 96us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.630945:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137766.630964:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137766.630970:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff811850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+8:8329:x1869755322493696:12345-0@lo:104: 00010000:00010000:0.0:1783137766.630978:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631012:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783137766.631017:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff811850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+8:8329:x1869755322493696:12345-0@lo:104: Request processed in 48us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631023:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137766.631074:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137766.631081:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+7:8329:x1869755322493824:12345-0@lo:104: 00010000:00010000:0.0:1783137766.631089:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631121:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783137766.631125:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+7:8329:x1869755322493824:12345-0@lo:104: Request processed in 46us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631131:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137766.631141:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137766.631147:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:8329:x1869755322493952:12345-0@lo:104: 00010000:00010000:0.0:1783137766.631154:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631179:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783137766.631183:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+6:8329:x1869755322493952:12345-0@lo:104: Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631188:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137766.631198:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137766.631202:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:8329:x1869755322494080:12345-0@lo:104: 00010000:00010000:0.0:1783137766.631208:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631231:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783137766.631235:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:8329:x1869755322494080:12345-0@lo:104: Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631240:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137766.631256:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137766.631262:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:8329:x1869755322494208:12345-0@lo:104: 00010000:00010000:0.0:1783137766.631269:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631294:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783137766.631299:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:8329:x1869755322494208:12345-0@lo:104: Request processed in 38us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631304:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137766.631315:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137766.631320:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:8329:x1869755322494336:12345-0@lo:104: 00010000:00010000:0.0:1783137766.631326:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631362:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783137766.631367:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:8329:x1869755322494336:12345-0@lo:104: Request processed in 48us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.631373:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783137766.631393:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783137766.631400:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631408:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d8a00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631412:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631422:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631442:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631449:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631486:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631493:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631516:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631524:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e021d8a00/0x4691dfc3d66b6f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f9c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631595:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783137766.631599:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631606:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631609:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631616:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631622:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631628:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631649:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631655:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631674:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631680:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b6f6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f72 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631690:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783137766.631693:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631698:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631701:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631707:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631713:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631718:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631730:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631736:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631742:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631759:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b6f4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631770:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783137766.631773:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631779:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631782:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631789:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631795:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631800:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631813:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631819:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631825:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631831:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4000/0x4691dfc3d66b6f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f48 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631840:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783137766.631849:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631855:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d5400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631857:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631864:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631869:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631874:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631886:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631891:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631894:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631900:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b6f33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f3a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631909:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137766.631911:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631917:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631919:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631936:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.631942:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.631948:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.631960:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631966:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.631971:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631978:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030200/0x4691dfc3d66b6f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f10 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631987:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137766.631991:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.631996:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137766.631999:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632006:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137766.632012:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137766.632024:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137766.632038:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632044:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137766.632049:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632055:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b6edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6ee6 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632073:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137766.632075:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137766.632077:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137766.632088:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137766.632096:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137766.632124:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494464:0@lo:103: 00000100:00100000:0.0:1783137766.632187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632228:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494976:0@lo:103: 00000100:00100000:0.0:1783137766.632251:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632272:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137766.632278:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494848:0@lo:103: 00000100:00100000:0.0:1783137766.632298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632328:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322494592:0@lo:103: 00000100:00100000:0.0:1783137766.632366:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632382:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322495104:0@lo:103: 00000100:00100000:0.0:1783137766.632401:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632420:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783137766.632426:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322494720:0@lo:103: 00000100:00100000:0.0:1783137766.632447:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632456:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322495232:0@lo:103: 00000100:00100000:0.0:1783137766.632475:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137766.632501:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494464 00000100:00100000:0.0:1783137766.632507:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494464 00010000:00010000:0.0:1783137766.632535:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 19 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632592:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494976 00000100:00100000:0.0:1783137766.632595:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494976 00010000:00010000:0.0:1783137766.632606:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 20 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632615:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494848 00000100:00100000:0.0:1783137766.632617:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494848 00010000:00010000:0.0:1783137766.632626:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 21 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632634:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494592 00000100:00100000:0.0:1783137766.632635:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494592 00010000:00010000:0.0:1783137766.632644:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 22 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632653:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495104 00000100:00100000:0.0:1783137766.632655:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495104 00010000:00010000:0.0:1783137766.632663:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 23 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632672:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322494720 00000100:00100000:0.0:1783137766.632674:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322494720 00010000:00010000:0.0:1783137766.632692:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 24 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632703:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495232 00000100:00100000:0.0:1783137766.632705:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495232 00010000:00010000:0.0:1783137766.632716:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 25 pid: 5807 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.632730:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137766.632738:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+25:3315:x1869755322494464:12345-0@lo:103: 00010000:00010000:0.0:1783137766.632751:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.632757:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 25 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632766:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 25 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632785:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.632815:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+25:3315:x1869755322494464:12345-0@lo:103: Request processed in 78us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.632822:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137766.632836:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137766.632842:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+24:3315:x1869755322494976:12345-0@lo:103: 00010000:00010000:0.0:1783137766.632849:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.632852:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 24 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632860:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 24 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632878:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.632896:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+24:3315:x1869755322494976:12345-0@lo:103: Request processed in 55us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.632901:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137766.632911:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137766.632916:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+23:3315:x1869755322494848:12345-0@lo:103: 00010000:00010000:0.0:1783137766.632922:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.632926:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 23 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632934:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 23 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632942:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.632957:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+23:3315:x1869755322494848:12345-0@lo:103: Request processed in 42us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.632963:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137766.632971:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137766.632976:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+22:3316:x1869755322494592:12345-0@lo:103: 00010000:00010000:0.0:1783137766.632982:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.632986:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 22 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.632993:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 22 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633001:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.633030:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+22:3316:x1869755322494592:12345-0@lo:103: Request processed in 53us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.633035:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137766.633046:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137766.633052:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+21:3316:x1869755322495104:12345-0@lo:103: 00010000:00010000:0.0:1783137766.633058:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.633063:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 21 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633070:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 21 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633080:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.633100:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+21:3316:x1869755322495104:12345-0@lo:103: Request processed in 49us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.633105:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137766.633117:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137766.633123:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3316:x1869755322494720:12345-0@lo:103: 00010000:00010000:0.0:1783137766.633129:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.633133:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 20 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633140:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 20 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633148:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.633167:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3316:x1869755322494720:12345-0@lo:103: Request processed in 45us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.633172:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137766.633190:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137766.633196:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322495232:12345-0@lo:103: 00010000:00010000:0.0:1783137766.633203:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.633208:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 19 pid: 5807 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633215:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 19 pid: 5807 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.633223:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.633242:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322495232:12345-0@lo:103: Request processed in 47us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.633248:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137766.633324:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322494720:0@lo:103: 00000100:00100000:0.0:1783137766.633335:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322495232:0@lo:103: 00000100:00100000:0.0:1783137766.633341:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322494592:0@lo:103: 00000100:00100000:0.0:1783137766.633362:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322495104:0@lo:103: 00000100:00100000:0.0:1783137766.633395:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494848:0@lo:103: 00000100:00100000:0.0:1783137766.633403:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494464:0@lo:103: 00000100:00100000:0.0:1783137766.633411:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322494976:0@lo:103: 00010000:00010000:2.0:1783137766.633592:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b6f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f95 expref: 18 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633609:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493568:0@lo:104: 00010000:00010000:2.0:1783137766.633620:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031c00/0x4691dfc3d66b6f72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f6b expref: 17 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633629:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493696:0@lo:104: 00010000:00010000:2.0:1783137766.633638:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02045200/0x4691dfc3d66b6f56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f4f expref: 16 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633646:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493824:0@lo:104: 00010000:00010000:2.0:1783137766.633666:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b6f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f41 expref: 15 pid: 5805 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633674:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493952:0@lo:104: 00010000:00010000:2.0:1783137766.633685:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b6f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f33 expref: 14 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633692:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494080:0@lo:104: 00010000:00010000:2.0:1783137766.633701:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02045800/0x4691dfc3d66b6f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6f09 expref: 13 pid: 5806 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633709:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494208:0@lo:104: 00010000:00010000:2.0:1783137766.633719:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5600/0x4691dfc3d66b6ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6edf expref: 12 pid: 5807 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.633727:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322494336:0@lo:104: 00000100:00100000:3.0:1783137766.639611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137766.639646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137766.639730:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401856 00000100:00100000:0.0:1783137766.639742:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401856 00010000:00010000:0.0:1783137766.639793:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 10 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.639849:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299401984 00000100:00100000:0.0:1783137766.639852:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299401984 00010000:00010000:0.0:1783137766.639865:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 11 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137766.639886:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1783137766.639896:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2353:x1869755299401856:12345-192.168.202.24@tcp:103: 00010000:00010000:0.0:1783137766.639914:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.639920:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 11 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.639933:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 11 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.639958:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.640023:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2353:x1869755299401856:12345-192.168.202.24@tcp:103: Request processed in 127us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.640030:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1783137766.640048:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1783137766.640054:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2353:x1869755299401984:12345-192.168.202.24@tcp:103: 00010000:00010000:0.0:1783137766.640060:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137766.640064:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 10 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640074:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 10 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640096:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640106:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640122:0:6630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640129:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640145:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640153:0:6630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640160:0:6630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137766.640165:0:6630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640174:0:6630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640185:0:6630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.640206:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137766.640226:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2353:x1869755299401984:12345-192.168.202.24@tcp:103: Request processed in 172us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137766.640241:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00010000:00010000:2.0:1783137766.640937:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e021d9400/0x4691dfc3d66b6fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392247e expref: 9 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.640959:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493312:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137766.640973:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b6faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922477 expref: 8 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137766.640981:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869755322493440:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137766.641036:0:8329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.641046:0:8329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.641062:0:8329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137766.641069:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6fe9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137766.907406:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137767.011997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137767.012047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137767.012088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137767.012184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137767.012223:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402496 00000100:00100000:3.0:1783137767.012235:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402496 00000100:00100000:3.0:1783137767.012322:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402368 00000100:00100000:3.0:1783137767.012325:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402368 00000100:00100000:3.0:1783137767.012362:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783137767.012375:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299402496:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1783137767.012478:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299402496:12345-192.168.202.24@tcp:400: Request processed in 104us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137767.012488:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783137767.012508:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1783137767.012514:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299402368:12345-192.168.202.24@tcp:400: 00000100:00100000:3.0:1783137767.012541:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299402368:12345-192.168.202.24@tcp:400: Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137767.012577:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:3.0:1783137767.012600:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137767.012604:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137767.012984:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402112 00000100:00100000:2.0:1783137767.012989:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402112 00000100:00100000:2.0:1783137767.013031:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:2.0:1783137767.013039:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+8:2352:x1869755299402112:12345-192.168.202.24@tcp:400: 00000100:00100000:2.0:1783137767.013075:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+8:2352:x1869755299402112:12345-192.168.202.24@tcp:400: Request processed in 37us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137767.013082:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:0.0:1783137767.013542:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402240 00000100:00100000:0.0:1783137767.013586:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402240 00000100:00100000:0.0:1783137767.013638:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:0.0:1783137767.013647:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299402240:12345-192.168.202.24@tcp:400: 00000100:00100000:0.0:1783137767.013684:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299402240:12345-192.168.202.24@tcp:400: Request processed in 39us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137767.013691:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00080000:3.0:1783137767.014172:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137767.099131:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322495616:0@lo:400: 00000100:00100000:3.0:1783137767.099275:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137767.099376:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137767.099384:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322495744:0@lo:400: 00000100:00100000:3.0:1783137767.099414:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137767.099594:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495616 00000100:00100000:1.0:1783137767.099604:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495616 00000100:00100000:1.0:1783137767.099687:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783137767.099699:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322495616:12345-0@lo:400: 00000100:00100000:1.0:1783137767.099774:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322495616:12345-0@lo:400: Request processed in 76us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137767.099783:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783137767.099951:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322495488:0@lo:400: 00000100:00100000:2.0:1783137767.099986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137767.100275:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783137767.100285:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322495360:0@lo:400: 00000100:00100000:2.0:1783137767.100312:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137767.100350:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322495872:0@lo:400: 00000100:00100000:2.0:1783137767.100375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137767.100412:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495872 00000100:00100000:2.0:1783137767.100416:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495872 00000100:00100000:1.0:1783137767.100525:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495744 00000100:00100000:1.0:1783137767.100529:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495744 00000100:00100000:1.0:1783137767.100581:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495488 00000100:00100000:1.0:1783137767.100584:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495488 00000100:00100000:1.0:1783137767.100598:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322495360 00000100:00100000:1.0:1783137767.100600:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322495360 00000100:00100000:1.0:1783137767.100614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137767.100622:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322495744:12345-0@lo:400: 00000100:00100000:1.0:1783137767.100660:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322495744:12345-0@lo:400: Request processed in 39us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137767.100667:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137767.100679:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783137767.100685:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322495488:12345-0@lo:400: 00000100:00100000:1.0:1783137767.100731:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322495488:12345-0@lo:400: Request processed in 46us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137767.100737:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783137767.100748:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137767.100754:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322495360:12345-0@lo:400: 00000100:00100000:1.0:1783137767.100778:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322495360:12345-0@lo:400: Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137767.100783:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137767.101185:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137767.101194:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322495872:12345-0@lo:400: 00000100:00100000:2.0:1783137767.101232:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322495872:12345-0@lo:400: Request processed in 40us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137767.101249:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137767.101298:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322495360:0@lo:400: 00010000:00080000:2.0:1783137767.101314:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216df80 x1869755322495872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137767.101325:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322495872:0@lo:400: 00000100:00100000:2.0:1783137767.101336:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322495488:0@lo:400: 00000100:00080000:3.0:1783137767.101943:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137767.101952:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137767.101955:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137767.101985:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322495744:0@lo:400: 00010000:00080000:3.0:1783137767.102001:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216ca80 x1869755322495616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137767.102158:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322495616:0@lo:400: 00000100:00100000:0.0:1783137767.611409:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137767.611444:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322496000:0@lo:13: 00000100:00100000:0.0:1783137767.611581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137767.612729:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496000 00000100:00100000:3.0:1783137767.612744:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496000 00000100:00100000:3.0:1783137767.612828:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137767.612841:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322496000:12345-0@lo:13: 00002000:00000024:3.0:1783137767.612898:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137767.612987:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322496000:12345-0@lo:13: Request processed in 148us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137767.612994:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783137767.613157:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01430700 x1869755322496000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137767.613182:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322496000:0@lo:13: 00010000:00010000:0.0:1783137767.932054:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783137768.058827:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783137768.058838:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dc5c0e000 from 39 10000000:01000000:0.0:1783137768.058847:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137768.058923:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137768.058937:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137768.058951:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137768.059012:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496128:0@lo:101: 00000100:00100000:0.0:1783137768.059138:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137768.059205:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.059366:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496128 00000100:00100000:2.0:1783137768.059378:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496128 00000100:00100000:2.0:1783137768.059748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783137768.059762:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+12:5809:x1869755322496128:12345-0@lo:101: 00010000:00010000:2.0:1783137768.059781:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.059802:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6ff0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.059838:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ff0 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.059850:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ff0 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.059862:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685600, rc 0) 00000100:00100000:2.0:1783137768.059926:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496128:12345-0@lo:101: Request processed in 168us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.059934:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783137768.060136:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496128:0@lo:101: 00010000:00010000:1.0:1783137768.060157:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.060167:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.060246:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496256:0@lo:501: 00000100:00100000:1.0:1783137768.060278:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.060319:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137768.060384:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496256 00000100:00100000:3.0:1783137768.060390:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496256 00000100:00100000:3.0:1783137768.060426:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783137768.060449:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496256:12345-0@lo:501: 00000100:00100000:3.0:1783137768.060835:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496256:12345-0@lo:501: Request processed in 386us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137768.060842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783137768.061022:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496256:0@lo:501: 00000100:00100000:1.0:1783137768.061060:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496384:0@lo:503: 00000100:00100000:1.0:1783137768.061104:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.061134:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137768.061436:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496384 00000100:00100000:3.0:1783137768.061442:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496384 00000100:00100000:1.0:1783137768.061888:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783137768.061902:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496384:12345-0@lo:503: 00000100:00100000:1.0:1783137768.062133:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496384:12345-0@lo:503: Request processed in 234us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.062148:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783137768.062218:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496384:0@lo:503: 00000100:00100000:1.0:1783137768.062514:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8345:1869755322496512:0@lo:502: 00000100:00100000:1.0:1783137768.062605:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.062629:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496512 00000100:00100000:1.0:1783137768.062634:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496512 00000100:00100000:1.0:1783137768.062659:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783137768.062667:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:8345:x1869755322496512:12345-0@lo:502: 00000100:00100000:1.0:1783137768.062833:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:8345:x1869755322496512:12345-0@lo:502: Request processed in 166us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.062841:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783137768.062883:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.062896:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8345:1869755322496512:0@lo:502: 00000100:00100000:1.0:1783137768.062938:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8345:1869755322496640:0@lo:502: 00000100:00100000:1.0:1783137768.062969:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.062987:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496640 00000100:00100000:1.0:1783137768.062990:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496640 00000100:00100000:1.0:1783137768.063008:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783137768.063013:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:8345:x1869755322496640:12345-0@lo:502: 00000100:00100000:1.0:1783137768.063126:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:8345:x1869755322496640:12345-0@lo:502: Request processed in 112us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.063133:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783137768.063156:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.063166:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8345:1869755322496640:0@lo:502: 00000040:00080000:1.0:1783137768.063190:0:8345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783137768.063253:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783137768.063272:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137768.063285:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063297:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137768.063309:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783137768.063313:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783137768.063316:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783137768.063357:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063367:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063378:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.063390:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496768:0@lo:101: 00000100:00100000:1.0:1783137768.063418:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.063430:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.063442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496768 00000100:00100000:1.0:1783137768.063446:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496768 00000100:00100000:1.0:1783137768.063464:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783137768.063469:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+13:5809:x1869755322496768:12345-0@lo:101: 00010000:00010000:1.0:1783137768.063478:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137768.063498:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b7005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b6ffe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063526:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ffe expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063536:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6ffe expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063577:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5200, rc 0) 00000100:00100000:1.0:1783137768.063606:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322496768:12345-0@lo:101: Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.063611:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783137768.063635:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496768:0@lo:101: 00010000:00010000:1.0:1783137768.063647:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.063656:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.063694:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496896:0@lo:501: 00000100:00100000:1.0:1783137768.063716:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.063733:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.063741:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322496896 00000100:00100000:1.0:1783137768.063744:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322496896 00000100:00100000:1.0:1783137768.063758:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783137768.063763:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322496896:12345-0@lo:501: 00000100:00100000:1.0:1783137768.064020:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322496896:12345-0@lo:501: Request processed in 255us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.064036:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783137768.064065:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322496896:0@lo:501: 00000100:00100000:1.0:1783137768.064092:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497024:0@lo:503: 00000100:00100000:1.0:1783137768.064132:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.064144:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5f026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.064154:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497024 00000100:00100000:1.0:1783137768.064173:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497024 00000100:00100000:1.0:1783137768.064191:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783137768.064196:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322497024:12345-0@lo:503: 00000100:00100000:1.0:1783137768.064344:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322497024:12345-0@lo:503: Request processed in 137us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.064351:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783137768.064383:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497024:0@lo:503: 00000100:00100000:1.0:1783137768.064714:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8346:1869755322497152:0@lo:502: 00000100:00100000:1.0:1783137768.064748:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.064767:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497152 00000100:00100000:1.0:1783137768.064770:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497152 00000100:00100000:1.0:1783137768.064788:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783137768.064793:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:8346:x1869755322497152:12345-0@lo:502: 00000100:00100000:1.0:1783137768.064918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:8346:x1869755322497152:12345-0@lo:502: Request processed in 124us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.064925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783137768.064962:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5f02480 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.064975:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8346:1869755322497152:0@lo:502: 00000020:01000000:1.0:1783137768.065005:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137768.065017:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137768.065020:0:8346:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783137768.065026:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783137768.065050:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8346:1869755322497280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.065078:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.065095:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497280 00000100:00100000:1.0:1783137768.065098:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497280 00000100:00100000:1.0:1783137768.065114:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783137768.065120:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:8346:x1869755322497280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.065212:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:8346:x1869755322497280:12345-0@lo:502:llog_process_th.0 Request processed in 92us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.065218:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783137768.065242:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5f02480 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.065253:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8346:1869755322497280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137768.065270:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137768.065274:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137768.065276:0:8346:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783137768.065280:0:8346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783137768.065323:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783137768.071931:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783137768.071959:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.071975:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137768.071989:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783137768.072017:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dc5ce5000 from 39 10000000:01000000:1.0:1783137768.072021:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137768.072075:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.072083:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.072096:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.072133:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.072224:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.072286:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5f02480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.072359:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497408 00000100:00100000:2.0:1783137768.072368:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497408 00000100:00100000:2.0:1783137768.072450:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783137768.072462:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:5809:x1869755322497408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137768.072481:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.072496:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5685000/0x4691dfc3d66b7013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b700c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.072527:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5685000/0x4691dfc3d66b7013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b700c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.072539:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5685000/0x4691dfc3d66b7013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b700c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.072581:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685000, rc 0) 00000100:00100000:2.0:1783137768.072629:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322497408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.072636:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783137768.073383:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137768.073404:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.073415:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.073506:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.073541:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.073607:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5f02480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137768.076593:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497536 00000100:00100000:0.0:1783137768.076613:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497536 00000100:00100000:0.0:1783137768.076698:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783137768.076709:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322497536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137768.077173:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322497536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 464us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137768.077182:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783137768.077455:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.077532:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.077626:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.077664:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187600 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.078371:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497664 00000100:00100000:1.0:1783137768.078379:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497664 00000100:00100000:1.0:1783137768.078443:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783137768.078453:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322497664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.078703:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322497664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.078717:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783137768.078926:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322497664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137768.080039:0:8347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8347:1869755322497792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137768.080145:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137768.080189:0:8347:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.080300:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497792 00000100:00100000:1.0:1783137768.080307:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497792 00000100:00100000:1.0:1783137768.080366:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783137768.080375:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:8347:x1869755322497792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.080670:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:8347:x1869755322497792:12345-0@lo:502:llog_process_th.0 Request processed in 294us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.080677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783137768.081050:0:8347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8347:1869755322497792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137768.081133:0:8347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8347:1869755322497920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137768.081170:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137768.081205:0:8347:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137768.081312:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322497920 00000100:00100000:3.0:1783137768.081317:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322497920 00000100:00100000:3.0:1783137768.081364:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783137768.081372:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:8347:x1869755322497920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137768.081615:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:8347:x1869755322497920:12345-0@lo:502:llog_process_th.0 Request processed in 243us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137768.081622:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783137768.081922:0:8347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8347:1869755322497920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783137768.081947:0:8347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783137768.082445:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783137768.082476:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783137768.082489:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.082502:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137768.082515:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783137768.082518:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1783137768.082521:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783137768.082947:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.082959:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.082970:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137768.082994:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.083057:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.083265:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498048 00000100:00100000:1.0:1783137768.083272:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498048 00000100:00100000:1.0:1783137768.083342:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783137768.083352:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:5809:x1869755322498048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137768.083366:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137768.083382:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d4000/0x4691dfc3d66b7021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b701a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.083411:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d4000/0x4691dfc3d66b7021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b701a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.083423:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d4000/0x4691dfc3d66b7021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b701a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.083450:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d4000, rc 0) 00000100:00100000:1.0:1783137768.083489:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.083496:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783137768.083735:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137768.083760:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137768.083779:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.083805:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137768.083873:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.083904:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.083922:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.084008:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498176 00000100:00100000:1.0:1783137768.084020:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498176 00000100:00100000:1.0:1783137768.084053:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783137768.084059:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.084416:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.084424:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783137768.084753:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.084797:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.084842:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137768.084873:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9e71600 going to sleep for 11 seconds 00000100:00100000:3.0:1783137768.085001:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498304 00000100:00100000:3.0:1783137768.085005:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498304 00000100:00100000:3.0:1783137768.085108:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783137768.085116:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.085305:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137768.085313:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783137768.088302:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137768.091077:0:8348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8348:1869755322498432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137768.091212:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137768.091261:0:8348:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.091640:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498432 00000100:00100000:2.0:1783137768.091651:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498432 00000100:00100000:2.0:1783137768.091716:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783137768.091728:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:8348:x1869755322498432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.092040:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:8348:x1869755322498432:12345-0@lo:502:llog_process_th.0 Request processed in 312us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.092055:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783137768.092475:0:8348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8348:1869755322498432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137768.092526:0:8348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137768.092540:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137768.092566:0:8348:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137768.092574:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783137768.092610:0:8348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8348:1869755322498560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137768.092660:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137768.092690:0:8348:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.092882:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498560 00000100:00100000:2.0:1783137768.092888:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498560 00000100:00100000:2.0:1783137768.092929:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783137768.092938:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:8348:x1869755322498560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.093121:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:8348:x1869755322498560:12345-0@lo:502:llog_process_th.0 Request processed in 183us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.093128:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783137768.093510:0:8348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8348:1869755322498560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137768.093869:0:8348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137768.093879:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137768.093881:0:8348:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783137768.093885:0:8348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783137768.094090:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783137768.094120:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783137768.094134:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.094147:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137768.094158:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783137768.094161:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dd09a3000 from 39 10000000:01000000:2.0:1783137768.094164:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783137768.094206:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.094217:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.094227:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137768.094251:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.094321:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137768.094367:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9e71540 going to sleep for 11 seconds 00000100:00100000:0.0:1783137768.094840:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498688 00000100:00100000:0.0:1783137768.094848:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498688 00000100:00100000:0.0:1783137768.094907:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783137768.094918:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322498688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137768.094936:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137768.094954:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b702f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b7028 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137768.094983:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b702f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b7028 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137768.094996:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b702f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b7028 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137768.095005:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031e00, rc 0) 00000100:00100000:0.0:1783137768.095066:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322498688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137768.095093:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783137768.095225:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137768.095244:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.095255:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.095320:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.095362:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.095395:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.095454:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498816 00000100:00100000:2.0:1783137768.095458:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498816 00000100:00100000:2.0:1783137768.095480:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783137768.095488:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322498816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.096080:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322498816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 582us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.096090:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783137768.096162:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.096202:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.096246:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.096277:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.096387:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322498944 00000100:00100000:2.0:1783137768.096392:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322498944 00000100:00100000:2.0:1783137768.096421:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783137768.096706:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322498944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.097121:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322498944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 691us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.097130:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783137768.101764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137768.101838:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402624 00000100:00100000:2.0:1783137768.101851:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402624 00000100:00100000:2.0:1783137768.101922:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:2.0:1783137768.101934:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+8:5582:x1869755299402624:12345-192.168.202.24@tcp:101: 00010000:00010000:2.0:1783137768.101955:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.101978:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684800/0x4691dfc3d66b7036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224e0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.102015:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684800/0x4691dfc3d66b7036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e0 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.102053:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684800/0x4691dfc3d66b7036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e0 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.102064:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684800, rc 0) 00000100:00100000:2.0:1783137768.102146:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299402624:12345-192.168.202.24@tcp:101: Request processed in 214us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.102154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:1.0:1783137768.112635:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322498944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.113285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137768.114988:0:8349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8349:1869755322499072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.115111:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137768.115171:0:8349:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.115276:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402752 00000100:00100000:1.0:1783137768.115285:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402752 00000100:00100000:1.0:1783137768.115350:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499072 00000100:00100000:1.0:1783137768.115353:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499072 00000100:00100000:1.0:1783137768.115375:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:1.0:1783137768.115396:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299402752:12345-192.168.202.24@tcp:501: 00000100:00100000:1.0:1783137768.115815:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299402752:12345-192.168.202.24@tcp:501: Request processed in 419us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.115825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:1.0:1783137768.115854:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783137768.115862:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8349:x1869755322499072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.116212:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8349:x1869755322499072:12345-0@lo:502:llog_process_th.0 Request processed in 350us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.116220:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783137768.116788:0:8349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8349:1869755322499072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.116863:0:8349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8349:1869755322499200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.116921:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137768.116952:0:8349:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.118634:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499200 00000100:00100000:1.0:1783137768.118649:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499200 00000100:00100000:1.0:1783137768.118715:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783137768.118726:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8349:x1869755322499200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.119060:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8349:x1869755322499200:12345-0@lo:502:llog_process_th.0 Request processed in 335us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.119067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783137768.119377:0:8349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8349:1869755322499200:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783137768.119425:0:8349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783137768.119795:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783137768.119818:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137768.119830:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.119843:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137768.119854:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783137768.119857:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783137768.119870:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137768.119920:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.119930:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.119939:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.119965:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.120011:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.120053:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.120590:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499328 00000100:00100000:2.0:1783137768.120597:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499328 00000100:00100000:2.0:1783137768.120645:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783137768.120654:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322499328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137768.120668:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.120685:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684c00/0x4691dfc3d66b7044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b703d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.120726:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684c00/0x4691dfc3d66b7044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b703d expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.120737:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684c00/0x4691dfc3d66b7044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b703d expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.120748:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684c00, rc 0) 00000100:00100000:2.0:1783137768.120806:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.120813:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783137768.120912:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137768.120930:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.120939:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137768.121011:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.121042:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.121089:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.121254:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499456 00000100:00100000:2.0:1783137768.121259:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499456 00000100:00100000:2.0:1783137768.121293:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783137768.121300:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.121778:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 477us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.121785:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783137768.124233:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.124327:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.124737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137768.124784:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299402880 00000100:00100000:2.0:1783137768.124792:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299402880 00000100:00100000:2.0:1783137768.124856:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:2.0:1783137768.124868:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299402880:12345-192.168.202.24@tcp:503: 00000100:00100000:2.0:1783137768.125129:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299402880:12345-192.168.202.24@tcp:503: Request processed in 262us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.125138:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:3.0:1783137768.125734:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.125781:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137768.125889:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499584 00000100:00100000:1.0:1783137768.125896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499584 00000100:00100000:1.0:1783137768.125934:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783137768.125943:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.126135:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.126144:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137768.127264:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.128632:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8350:1869755322499712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137768.128740:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.128792:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.128950:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499712 00000100:00100000:2.0:1783137768.128965:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499712 00000100:00100000:2.0:1783137768.129017:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783137768.129028:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8350:x1869755322499712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.129318:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8350:x1869755322499712:12345-0@lo:502:llog_process_th.0 Request processed in 290us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.129327:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783137768.129443:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8350:1869755322499712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137768.129481:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137768.129495:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137768.129498:0:8350:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783137768.129505:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783137768.129537:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8350:1869755322499840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137768.129655:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.129685:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.129756:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499840 00000100:00100000:2.0:1783137768.129761:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499840 00000100:00100000:2.0:1783137768.129797:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783137768.129806:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8350:x1869755322499840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137768.129958:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8350:x1869755322499840:12345-0@lo:502:llog_process_th.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.129965:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783137768.130387:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8350:1869755322499840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137768.130415:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137768.130423:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137768.130425:0:8350:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783137768.130430:0:8350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1783137768.130919:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1783137768.130946:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783137768.130960:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.130973:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137768.130988:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783137768.130991:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5dc5dd19c0 from 1 10000000:01000000:3.0:1783137768.130994:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783137768.131031:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.131041:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137768.131052:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137768.131074:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137768.131123:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137768.131178:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.131291:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322499968 00000100:00100000:2.0:1783137768.131297:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322499968 00000100:00100000:2.0:1783137768.131350:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783137768.131359:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322499968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137768.131374:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.131387:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684400/0x4691dfc3d66b7052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b704b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.131421:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684400/0x4691dfc3d66b7052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b704b expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.131447:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684400/0x4691dfc3d66b7052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b704b expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.131457:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684400, rc 0) 00000100:00100000:2.0:1783137768.131508:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322499968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.131516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783137768.131806:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322499968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137768.131822:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.131832:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137768.131904:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322500096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137768.131937:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137768.131970:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137768.132058:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500096 00000100:00100000:2.0:1783137768.132063:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500096 00000100:00100000:2.0:1783137768.132094:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783137768.132101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322500096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.132362:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322500096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (423us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137768.132369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783137768.132705:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322500096:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783137768.132735:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783137768.132740:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137768.132749:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137768.146368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137768.146475:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403008 00000100:00100000:1.0:1783137768.146489:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403008 00000100:00100000:1.0:1783137768.146597:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:1.0:1783137768.146610:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:6054:x1869755299403008:12345-192.168.202.24@tcp:502: 00000100:00100000:1.0:1783137768.146971:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+9:6054:x1869755299403008:12345-192.168.202.24@tcp:502: Request processed in 363us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137768.146981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:2.0:1783137768.155648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137768.155759:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403136 00000100:00100000:3.0:1783137768.155775:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403136 00000100:00100000:3.0:1783137768.155851:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:3.0:1783137768.155863:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+9:6054:x1869755299403136:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137768.156247:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+9:6054:x1869755299403136:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 385us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137768.156256:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:3.0:1783137768.160502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137768.160634:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403264 00000100:00100000:2.0:1783137768.160647:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403264 00000100:00100000:2.0:1783137768.160706:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:2.0:1783137768.160718:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299403264:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137768.160739:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137768.160761:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5685e00/0x4691dfc3d66b7059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224e7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.160799:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5685e00/0x4691dfc3d66b7059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e7 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.160813:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5685e00/0x4691dfc3d66b7059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e7 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137768.160825:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685e00, rc 0) 00000100:00100000:2.0:1783137768.160904:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403264:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 189us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137768.160933:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:0.0:1783137768.169463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137768.169524:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403392 00000100:00100000:2.0:1783137768.169538:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403392 00000100:00100000:2.0:1783137768.169641:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 170 00000100:00100000:2.0:1783137768.169654:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403392:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137768.170047:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403392:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 394us (599us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137768.170056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 170 00010000:00010000:0.0:1783137768.958745:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137769.755315:0:8387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5daa2a90 20000000:00000080:3.0:1783137769.755350:0:8387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5dfb115c00 uarg=0000000000000000 20000000:01000000:3.0:1783137769.755402:0:8387:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783137769.755410:0:8387:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783137769.755417:0:8387:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783137769.757208:0:8388:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783137769.757495:0:8387:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783137769.764284:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783137769.764377:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783137769.764437:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783137769.764459:0:8387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783137769.764485:0:8387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764508:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764517:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764526:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764587:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764597:0:8387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764649:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.764667:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 9 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137769.764685:0:8387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500224:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137769.765243:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.765252:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 18 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137769.765263:0:8387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500352:0@lo:104: 00000100:00100000:3.0:1783137769.766462:0:8387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783137769.766531:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.766561:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 18 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137769.766575:0:8387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500480:0@lo:104: 00000100:00100000:3.0:1783137769.766623:0:8387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783137769.766650:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137769.766658:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 18 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137769.766666:0:8387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500608:0@lo:104: 00000100:00100000:3.0:1783137769.766689:0:8387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb1876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137769.767152:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783137769.767179:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137769.767200:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500352 00000100:00100000:1.0:1783137769.767208:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500352 00000100:00100000:1.0:1783137769.767269:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500480 00000100:00100000:1.0:1783137769.767272:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500480 00000100:00100000:1.0:1783137769.767284:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500608 00000100:00100000:1.0:1783137769.767286:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500608 00000100:00100000:1.0:1783137769.767301:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783137769.767311:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:8387:x1869755322500352:12345-0@lo:104: 00010000:00010000:1.0:1783137769.767339:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767421:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137769.767428:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+5:8387:x1869755322500352:12345-0@lo:104: Request processed in 119us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.767436:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783137769.767456:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783137769.767463:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0143e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:8387:x1869755322500480:12345-0@lo:104: 00010000:00010000:1.0:1783137769.767471:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767509:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783137769.767514:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0143e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:8387:x1869755322500480:12345-0@lo:104: Request processed in 52us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.767535:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783137769.767607:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137769.767614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:8387:x1869755322500608:12345-0@lo:104: 00010000:00010000:1.0:1783137769.767621:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767654:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783137769.767658:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:8387:x1869755322500608:12345-0@lo:104: Request processed in 46us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.767664:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783137769.767682:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783137769.767688:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767695:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137769.767700:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767710:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137769.767718:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137769.767725:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137769.767773:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767780:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137769.767812:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767946:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b6efb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6f02 expref: -99 pid: 7504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767964:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783137769.767967:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767972:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9a00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137769.767975:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.767981:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137769.767987:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137769.767992:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137769.768008:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768014:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137769.768020:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768026:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9a00/0x4691dfc3d66b6e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6e37 expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768036:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137769.768045:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768050:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137769.768053:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768060:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137769.768066:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137769.768072:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137769.768085:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768091:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137769.768109:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768115:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044200/0x4691dfc3d66b6dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b6dd5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.768380:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137769.768383:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137769.768385:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137769.768397:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137769.768404:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137769.768431:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322500736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137769.768481:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137769.768537:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137769.768572:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322500864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137769.768603:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137769.768638:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322500992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137769.768663:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137769.768701:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500736 00000100:00100000:1.0:1783137769.768707:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500736 00010000:00010000:1.0:1783137769.768735:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 19 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137769.768758:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500864 00000100:00100000:1.0:1783137769.768762:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500864 00010000:00010000:1.0:1783137769.768772:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 20 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137769.768782:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322500992 00000100:00100000:1.0:1783137769.768784:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322500992 00010000:00010000:1.0:1783137769.768792:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 21 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137769.768804:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137769.768811:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+21:3316:x1869755322500736:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137769.769498:0:8387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500352:0@lo:104: 00000100:00100000:3.0:1783137769.769511:0:8387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500480:0@lo:104: 00000100:00100000:3.0:1783137769.769519:0:8387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500608:0@lo:104: 00010000:00010000:1.0:1783137769.769591:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137769.769607:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 21 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769619:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 21 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769638:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4a00/0x4691dfc3d66b6f02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6efb expref: 21 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769671:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137769.769725:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3316:x1869755322500736:12345-0@lo:103:ldlm_bl.0 Request processed in 914us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.769743:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137769.769772:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783137769.769782:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322500864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137769.769794:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137769.769798:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 19 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769806:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 19 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769890:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b6e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6e30 expref: 19 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769900:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137769.769924:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:3316:x1869755322500864:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.769931:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783137769.769945:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783137769.769952:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3314:x1869755322500992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137769.769960:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137769.769964:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 17 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769971:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 17 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769988:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b6dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b6dce expref: 17 pid: 5806 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.769998:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137769.770029:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322500992:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.770035:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783137769.770079:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322500992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137769.772167:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322500864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137769.772185:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322500736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137769.775467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137769.775643:0:8387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1869755322500224:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137769.775687:0:8387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137769.775995:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403520 00000100:00100000:1.0:1783137769.776005:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403520 00010000:00010000:1.0:1783137769.776052:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137769.776107:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:1.0:1783137769.776119:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299403520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137769.776257:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137769.776265:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776279:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776300:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a6e00/0x4691dfc3d66b6fbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224af expref: 10 pid: 5805 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776332:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776366:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776384:0:6630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776393:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776400:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776407:0:6630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776414:0:6630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137769.776420:0:6630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776429:0:6630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776454:0:6630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137769.776464:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137769.776536:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+9:2352:x1869755299403520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 419us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137769.776575:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00010000:00010000:2.0:1783137769.776679:0:8387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137769.776687:0:8387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137769.776694:0:8387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b7060 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137769.978707:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137770.173589:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137770.174382:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322501120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137770.174481:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137770.175183:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501120 00000100:00100000:3.0:1783137770.175196:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501120 00000100:00100000:3.0:1783137770.175331:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137770.175346:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322501120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137770.175400:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137770.175579:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322501120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137770.175589:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783137770.175676:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137770.175955:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5beed80 x1869755322501120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137770.175987:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322501120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137771.005088:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137771.174713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137771.174830:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403648 00000100:00100000:1.0:1783137771.174843:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403648 00000100:00100000:1.0:1783137771.174918:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 171 00000100:00100000:1.0:1783137771.174929:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+9:5582:x1869755299403648:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137771.174952:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137771.174979:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224ee expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.175015:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.175027:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.175037:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d5800, rc 0) 00000100:00100000:1.0:1783137771.175101:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403648:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137771.175109:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 171 00000100:00100000:0.0:1783137771.183357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137771.184345:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403776 00000100:00100000:3.0:1783137771.184364:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403776 00000100:00100000:3.0:1783137771.184455:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:3.0:1783137771.184470:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403776:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137771.187497:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403776:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 3014us (4138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.187515:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:3.0:1783137771.200442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137771.200508:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299403904 00000100:00100000:3.0:1783137771.200522:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299403904 00000100:00100000:3.0:1783137771.201378:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:3.0:1783137771.201392:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403904:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137771.202027:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:5582:x1869755299403904:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 631us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.202038:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:1.0:1783137771.217639:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137771.219581:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404032 00000100:00100000:3.0:1783137771.219601:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404032 00000100:00100000:3.0:1783137771.219683:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:3.0:1783137771.219697:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:6112:x1869755299404032:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137771.220041:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:6112:x1869755299404032:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 346us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.220050:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:0.0:1783137771.225997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137771.227975:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404160 00000100:00100000:3.0:1783137771.227994:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404160 00000100:00100000:3.0:1783137771.228063:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:3.0:1783137771.228076:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:6112:x1869755299404160:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137771.228447:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:6112:x1869755299404160:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 372us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.228456:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 175 10000000:01000000:2.0:1783137771.578675:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137771.578683:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5c0e000 from 4 10000000:01000000:2.0:1783137771.578688:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137771.578746:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.578759:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.578783:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137771.578812:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.578895:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.578952:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.578973:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501248 00000100:00100000:2.0:1783137771.578980:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501248 00000100:00100000:2.0:1783137771.579027:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783137771.579036:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322501248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137771.579050:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137771.579062:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b706e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.579084:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.579096:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.579104:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684e00, rc 0) 00000100:00100000:2.0:1783137771.579155:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.579162:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783137771.579236:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137771.579257:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.579274:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137771.579341:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.579365:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.579379:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.579394:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501376 00000100:00100000:2.0:1783137771.579397:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501376 00000100:00100000:2.0:1783137771.579446:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783137771.579453:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.582279:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2819us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.582288:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783137771.582367:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.583613:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.583675:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.583712:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.583733:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501504 00000100:00100000:2.0:1783137771.583741:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501504 00000100:00100000:2.0:1783137771.583802:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783137771.583810:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.583955:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.583960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783137771.584004:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.584165:0:8458:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8458:1869755322501632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137771.584196:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.584215:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501632 00000100:00100000:2.0:1783137771.584219:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501632 00000100:00100000:2.0:1783137771.584238:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783137771.584244:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8458:x1869755322501632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137771.584387:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8458:x1869755322501632:12345-0@lo:502:llog_process_th.0 Request processed in 142us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.584394:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783137771.584440:0:8458:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187180 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.584453:0:8458:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8458:1869755322501632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137771.584471:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137771.584481:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137771.584483:0:8458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783137771.585954:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dc5c0e000 00000020:00000080:2.0:1783137771.585958:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137771.589838:0:8458:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8458:1869755322501760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137771.589952:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137771.590014:0:8458:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc671bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.592294:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501760 00000100:00100000:2.0:1783137771.592319:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501760 00000100:00100000:2.0:1783137771.592383:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783137771.592392:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8458:x1869755322501760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137771.593285:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:8458:x1869755322501760:12345-0@lo:502:llog_process_th.0 Request processed in 891us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.593292:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783137771.593420:0:8458:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8458:1869755322501760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137771.593453:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137771.593474:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137771.593477:0:8458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783137771.593483:0:8458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783137771.594153:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783137771.594202:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137771.594219:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.594234:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137771.594247:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137771.594250:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5ce5000 from 4 10000000:01000000:0.0:1783137771.594253:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137771.594300:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.594319:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.594331:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137771.594367:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.594445:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137771.594500:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.594743:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322501888 00000100:00100000:2.0:1783137771.594752:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322501888 00000100:00100000:2.0:1783137771.596138:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783137771.596155:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322501888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137771.596174:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137771.596193:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b707c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.596223:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.596234:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137771.596243:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684a00, rc 0) 00000100:00100000:2.0:1783137771.596335:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322501888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.596341:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783137771.598989:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322501888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137771.599041:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.599058:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137771.599869:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137771.599966:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137771.600047:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc671b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.600789:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502016 00000100:00100000:2.0:1783137771.600805:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502016 00000100:00100000:2.0:1783137771.601018:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783137771.601031:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322502016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.601409:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322502016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.601421:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783137771.601499:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.601705:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.601757:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.601789:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.601803:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502144 00000100:00100000:2.0:1783137771.601807:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502144 00000100:00100000:2.0:1783137771.601828:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783137771.601834:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322502144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137771.601982:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322502144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.601988:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783137771.602019:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.603037:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8461:1869755322502272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137771.603098:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137771.603136:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b0c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137771.603178:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502272 00000100:00100000:2.0:1783137771.603187:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502272 00000100:00100000:2.0:1783137771.603225:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783137771.603231:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8461:x1869755322502272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137771.607182:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8461:x1869755322502272:12345-0@lo:502:llog_process_th.0 Request processed in 3936us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137771.607200:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783137771.607326:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8461:1869755322502272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137771.607373:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137771.607388:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137771.607392:0:8461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783137771.608257:0:8461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dc5ce5000 00000020:00000080:2.0:1783137771.608262:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783137771.610322:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8461:1869755322502400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137771.611722:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137771.611784:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137771.611803:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502400 00000100:00100000:0.0:1783137771.611820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502400 00000100:00100000:0.0:1783137771.611902:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783137771.611916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8461:x1869755322502400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137771.612319:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:8461:x1869755322502400:12345-0@lo:502:llog_process_th.0 Request processed in 405us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137771.612328:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783137771.613968:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8461:1869755322502400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137771.614736:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137771.614751:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137771.614754:0:8461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783137771.614762:0:8461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783137771.615227:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783137771.615267:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137771.615283:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.615297:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137771.615322:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137771.615325:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd09a3000 from 4 10000000:01000000:0.0:1783137771.615329:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137771.615375:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.615398:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.615412:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137771.615444:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.615706:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137771.615774:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137771.615847:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502528 00000100:00100000:1.0:1783137771.615857:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502528 00000100:00100000:1.0:1783137771.615916:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783137771.615927:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322502528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137771.615946:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137771.615962:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b708a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.615992:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.616003:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.616014:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc29d4e00, rc 0) 00000100:00100000:1.0:1783137771.616061:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322502528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137771.616070:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783137771.616172:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137771.616189:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137771.616199:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137771.616259:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.616289:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137771.616465:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137771.616770:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502656 00000100:00100000:3.0:1783137771.616776:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502656 00000100:00100000:3.0:1783137771.616850:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783137771.616859:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322502656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137771.617276:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322502656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.617285:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783137771.617627:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.617682:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137771.617747:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137771.617806:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc878ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137771.617978:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502784 00000100:00100000:3.0:1783137771.617984:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502784 00000100:00100000:3.0:1783137771.618039:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783137771.618050:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322502784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137771.618277:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322502784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137771.618284:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783137771.618389:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322502784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137771.619062:0:8463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8463:1869755322502912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137771.619116:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137771.619158:0:8463:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137771.619219:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322502912 00000100:00100000:0.0:1783137771.619231:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322502912 00000100:00100000:0.0:1783137771.619271:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783137771.619282:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:8463:x1869755322502912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137771.619509:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:8463:x1869755322502912:12345-0@lo:502:llog_process_th.0 Request processed in 228us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137771.619517:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783137771.619718:0:8463:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8463:1869755322502912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137771.619759:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137771.619770:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137771.619773:0:8463:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783137771.619781:0:8463:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dd09a3000 00000020:00000080:3.0:1783137771.619783:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783137771.619948:0:8463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8463:1869755322503040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137771.619983:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137771.620006:0:8463:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137771.620118:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503040 00000100:00100000:1.0:1783137771.620130:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503040 00000100:00100000:1.0:1783137771.620160:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783137771.620167:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:8463:x1869755322503040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137771.620346:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:8463:x1869755322503040:12345-0@lo:502:llog_process_th.0 Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137771.620353:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783137771.620428:0:8463:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:8463:1869755322503040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137771.620451:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137771.620456:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137771.620457:0:8463:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783137771.620461:0:8463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783137771.620722:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783137771.620757:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137771.620769:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137771.620782:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137772.026815:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137772.135353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137772.135484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137772.135534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137772.135584:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404672 00000100:00100000:2.0:1783137772.135594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137772.135599:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404672 00000100:00100000:2.0:1783137772.135625:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404544 00000100:00100000:2.0:1783137772.135630:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404544 00000100:00100000:1.0:1783137772.135731:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404416 00000100:00100000:1.0:1783137772.135736:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404416 00000100:00100000:1.0:1783137772.135773:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1783137772.135784:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299404416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137772.135915:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299404416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 133us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137772.135923:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1783137772.135951:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404288 00000100:00100000:1.0:1783137772.135954:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404288 00000100:00100000:1.0:1783137772.135977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:1.0:1783137772.135983:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2353:x1869755299404288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137772.136010:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2353:x1869755299404288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137772.136034:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:0.0:1783137772.141512:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783137772.141541:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299404544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137772.141694:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299404544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 167us (6099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.141705:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783137772.141732:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1783137772.141741:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299404672:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137772.141772:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299404672:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.141779:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00080000:3.0:1783137772.143615:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137772.143629:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137772.143632:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137772.218847:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322503424:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.218948:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322503296:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219034:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137772.219087:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322503808:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219112:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137772.219143:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137772.219148:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322503168:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137772.219202:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322503680:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219222:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137772.219251:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503296 00000100:00100000:0.0:1783137772.219260:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503296 00000100:00100000:0.0:1783137772.219326:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503680 00000100:00100000:0.0:1783137772.219329:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503680 00000100:00100000:0.0:1783137772.219359:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137772.219368:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322503296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219430:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322503296:12345-0@lo:400:kworker.0 Request processed in 62us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.219437:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137772.219455:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137772.219460:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322503680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219481:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322503680:12345-0@lo:400:kworker.0 Request processed in 21us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.219487:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137772.219504:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503808 00000100:00100000:0.0:1783137772.219507:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503808 00000100:00100000:0.0:1783137772.219536:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137772.219541:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322503808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219632:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322503808:12345-0@lo:400:kworker.0 Request processed in 90us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.219639:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137772.219656:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503168 00000100:00100000:0.0:1783137772.219660:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503168 00000100:00100000:0.0:1783137772.219684:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783137772.219689:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322503168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219725:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322503168:12345-0@lo:400:kworker.0 Request processed in 37us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.219731:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783137772.219793:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322503168:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219805:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322503680:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.219814:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322503296:0@lo:400:kworker.0 00010000:00080000:0.0:1783137772.219826:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216f800 x1869755322503808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137772.219837:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322503808:0@lo:400:kworker.0 00000100:00080000:3.0:1783137772.219977:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137772.219983:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137772.220139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137772.220169:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137772.220176:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322503552:0@lo:400:kworker.0 00000100:00100000:1.0:1783137772.220196:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137772.220262:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503552 00000100:00100000:3.0:1783137772.220266:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503552 00000100:00100000:3.0:1783137772.220325:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783137772.220333:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322503552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137772.220372:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322503552:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137772.220377:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1783137772.220467:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137772.220487:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216ca80 x1869755322503552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137772.220498:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322503552:0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.220563:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503424 00000100:00100000:0.0:1783137772.220567:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503424 00000100:00100000:0.0:1783137772.220602:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783137772.220608:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322503424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137772.220645:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322503424:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137772.220651:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783137772.220672:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322503424:0@lo:400:kworker.0 00000100:00080000:1.0:1783137772.220718:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137772.730988:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322503936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137772.731099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137772.731657:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322503936 00000100:00100000:2.0:1783137772.731669:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322503936 00000100:00100000:2.0:1783137772.731742:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137772.731754:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322503936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137772.731806:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137772.731881:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322503936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137772.731889:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783137772.732249:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433480 x1869755322503936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137772.732273:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322503936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137773.050933:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137774.074796:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137775.099005:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137775.295582:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137775.295680:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137775.295858:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504064 00000100:00100000:1.0:1783137775.295866:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504064 00000100:00100000:1.0:1783137775.295934:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137775.295945:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137775.295981:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137775.296025:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137775.296033:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1783137775.296051:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137775.299969:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bed880 x1869755322504064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137775.300027:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137776.122800:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137777.152218:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137777.249716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137777.249755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137777.249803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137777.249829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137777.249881:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404928 00000100:00100000:0.0:1783137777.249892:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404928 00000100:00100000:3.0:1783137777.250005:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405184 00000100:00100000:3.0:1783137777.250010:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405184 00000100:00100000:0.0:1783137777.250147:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:0.0:1783137777.250158:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299404928:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137777.250285:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299404928:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 104us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.250294:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:0.0:1783137777.250326:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405056 00000100:00100000:0.0:1783137777.250331:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405056 00000100:00100000:3.0:1783137777.255745:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1783137777.255763:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299405184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137777.256674:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299405184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 915us (6916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137777.256683:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1783137777.256718:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299404800 00000100:00100000:3.0:1783137777.256727:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299404800 00000100:00100000:3.0:1783137777.256757:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:3.0:1783137777.256765:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2350:x1869755299404800:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137777.256956:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2350:x1869755299404800:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 191us (7152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137777.256963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:0.0:1783137777.260541:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1783137777.260619:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299405056:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137777.262491:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299405056:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1867us (12638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.262522:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00080000:2.0:1783137777.274346:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137777.274356:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137777.274360:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137777.346797:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322504192:0@lo:400:kworker.0 00000100:00100000:1.0:1783137777.346896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137777.347072:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137777.347080:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322504320:0@lo:400:kworker.0 00000100:00100000:1.0:1783137777.347109:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137777.350016:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504192 00000100:00100000:3.0:1783137777.350029:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504192 00000100:00100000:3.0:1783137777.350094:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783137777.350106:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322504192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137777.350196:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322504192:12345-0@lo:400:kworker.0 Request processed in 93us (3300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137777.350204:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783137777.350275:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322504192:0@lo:400:kworker.0 00000100:00100000:1.0:1783137777.352419:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322504448:0@lo:400:kworker.0 00000100:00100000:1.0:1783137777.352481:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137777.352697:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504320 00000100:00100000:0.0:1783137777.352706:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504320 00000100:00100000:0.0:1783137777.352746:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504448 00000100:00100000:0.0:1783137777.352749:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504448 00000100:00100000:0.0:1783137777.352809:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137777.352819:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322504320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.352872:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322504320:12345-0@lo:400:kworker.0 Request processed in 54us (5762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.352946:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137777.352961:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137777.352968:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322504448:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783137777.353029:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137777.358676:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322504448:12345-0@lo:400:kworker.0 Request processed in 5696us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.358692:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137777.358776:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322504320:0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.358842:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504576:0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.358905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137777.358946:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504576 00000100:00100000:0.0:1783137777.358963:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504576 00000100:00100000:0.0:1783137777.359019:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783137777.359026:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.359068:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504576:12345-0@lo:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.359073:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1783137777.359096:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322504576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137777.359106:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504576:0@lo:400:kworker.0 00000100:00080000:0.0:1783137777.359121:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137777.359144:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137777.359151:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322504704:0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.359175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137777.359194:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504704 00000100:00100000:0.0:1783137777.359197:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504704 00000100:00100000:0.0:1783137777.359219:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137777.359224:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322504704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.359252:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322504704:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.359276:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137777.359301:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322504704:0@lo:400:kworker.0 00000100:00080000:0.0:1783137777.359314:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137777.359336:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322504832:0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.359357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137777.359378:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504832 00000100:00100000:0.0:1783137777.359382:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504832 00000100:00100000:0.0:1783137777.359407:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137777.359413:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322504832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137777.359442:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322504832:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137777.359447:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783137777.359470:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322504832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137777.359479:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322504832:0@lo:400:kworker.0 00000100:00080000:0.0:1783137777.359501:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137777.363630:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322504448:0@lo:400:kworker.0 00000001:02000400:0.0:1783137777.411603:0:8687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1783137777.852291:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137777.852315:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137777.852383:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137777.852442:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322504960 00000100:00100000:3.0:1783137777.852449:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322504960 00000100:00100000:3.0:1783137777.852569:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137777.852577:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137777.852610:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137777.852657:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322504960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137777.852664:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1783137777.852707:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322504960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137777.852727:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322504960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137778.170785:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137779.194686:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137780.227186:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137780.420681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137780.427671:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322505088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137780.427791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137780.427854:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505088 00000100:00100000:1.0:1783137780.427863:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505088 00000100:00100000:1.0:1783137780.427937:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783137780.427947:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322505088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137780.428007:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137780.428057:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322505088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137780.428064:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783137780.428087:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137780.428135:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322505088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137780.428156:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322505088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137781.246061:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137782.271201:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137782.370380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137782.370443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137782.370485:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405440 00000100:00100000:2.0:1783137782.370495:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405440 00000100:00100000:2.0:1783137782.370592:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1783137782.370603:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299405440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137782.370831:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405312 00000100:00100000:0.0:1783137782.370835:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405312 00000100:00100000:0.0:1783137782.370869:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:0.0:1783137782.370876:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299405312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137782.370946:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299405440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 325us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137782.370955:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00080000:2.0:1783137782.370980:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137782.371282:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299405312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 405us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137782.371290:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:0.0:1783137782.378608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137782.378654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137782.378769:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405568 00000100:00100000:2.0:1783137782.378780:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405568 00000100:00100000:2.0:1783137782.378837:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405696 00000100:00100000:2.0:1783137782.378841:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405696 00000100:00100000:2.0:1783137782.378865:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783137782.378875:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2349:x1869755299405568:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:2.0:1783137782.378912:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6fcd 00000100:00080000:2.0:1783137782.378923:0:6617:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137782.378980:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783137782.379343:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+2:2349:x1869755299405568:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 469us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137782.379353:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783137782.379372:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1783137782.379379:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2349:x1869755299405696:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:2.0:1783137782.379395:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6fd4 00000100:00080000:2.0:1783137782.379403:0:6617:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137782.379425:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783137782.379868:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+2:2349:x1869755299405696:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 487us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137782.379876:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00010000:00010000:2.0:1783137782.380057:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783137782.380065:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137782.380069:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137782.380237:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137782.469961:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322505344:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470051:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470100:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322505856:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470125:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470156:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783137782.470162:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322505216:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470190:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470211:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322505728:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470245:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470270:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322505472:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470344:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137782.470350:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322505600:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137782.470403:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505344 00000100:00100000:1.0:1783137782.470410:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505344 00000100:00100000:1.0:1783137782.470460:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505728 00000100:00100000:1.0:1783137782.470463:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505728 00000100:00100000:1.0:1783137782.470487:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505472 00000100:00100000:1.0:1783137782.470490:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505472 00000100:00100000:1.0:1783137782.470506:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783137782.470514:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322505344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470591:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322505344:12345-0@lo:400:kworker.0 Request processed in 77us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.470598:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783137782.470614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783137782.470620:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322505728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470658:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322505728:12345-0@lo:400:kworker.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.470664:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783137782.470686:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783137782.470695:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322505472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470727:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322505472:12345-0@lo:400:kworker.0 Request processed in 34us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.470733:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783137782.470750:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505216 00000100:00100000:1.0:1783137782.470754:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505216 00000100:00100000:1.0:1783137782.470792:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783137782.470799:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470828:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322505216:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.470835:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783137782.470864:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505856 00000100:00100000:1.0:1783137782.470867:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505856 00000100:00100000:1.0:1783137782.470891:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505600 00000100:00100000:1.0:1783137782.470894:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505600 00000100:00100000:1.0:1783137782.470913:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783137782.470920:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322505856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.470950:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322505856:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.470956:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783137782.470966:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137782.470972:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322505600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.471011:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322505600:12345-0@lo:400:kworker.0 Request processed in 38us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137782.471016:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783137782.471036:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137782.471041:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137782.471043:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783137782.471077:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7c380 x1869755322505600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137782.471091:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322505600:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.471102:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322505472:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.471133:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322505216:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.471144:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322505728:0@lo:400:kworker.0 00000100:00100000:1.0:1783137782.471154:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322505344:0@lo:400:kworker.0 00010000:00080000:1.0:1783137782.471163:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7ea00 x1869755322505856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137782.471173:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322505856:0@lo:400:kworker.0 00000100:00100000:2.0:1783137782.970737:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137782.970763:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322505984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137782.971103:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137782.971400:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322505984 00000100:00100000:3.0:1783137782.971408:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322505984 00000100:00100000:3.0:1783137782.971472:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783137782.971482:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322505984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137782.971519:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137782.971588:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322505984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137782.971595:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783137782.971625:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432300 x1869755322505984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137782.971643:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322505984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137783.292627:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137783.610286:0:8931:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing yml_node 00010000:00010000:0.0:1783137784.315156:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137785.339873:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137785.531852:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137785.531877:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322506112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137785.531948:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137785.532047:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506112 00000100:00100000:0.0:1783137785.532055:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506112 00000100:00100000:0.0:1783137785.532114:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137785.532123:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322506112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137785.532156:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137785.532216:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322506112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137785.532223:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783137785.532506:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137785.532536:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bee680 x1869755322506112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137785.532607:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322506112:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1783137786.135134:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137786.135144:0:7522:0:(genops.c:906:class_export_put()) final put ffff8e5dffbce000/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137786.135172:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbce000/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-OST0001 00000020:00000080:2.0:1783137786.135246:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffbcb800 for lustre-OST0001 00010000:00010000:3.0:1783137786.363054:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137786.651255:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:3.0:1783137786.651273:0:6642:0:(genops.c:906:class_export_put()) final put ffff8e5dffbcc800/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:0.0:1783137786.651466:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbcc800/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-OST0000 00000020:00000080:0.0:1783137786.651514:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffbcb000 for lustre-OST0000 00010000:00010000:0.0:1783137787.387402:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137787.492003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137787.492061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137787.492199:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405952 00000100:00100000:1.0:1783137787.492209:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405952 00000100:00100000:1.0:1783137787.492297:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:1.0:1783137787.492308:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299405952:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137787.492384:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299405952:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137787.492392:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:0.0:1783137787.493019:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299405824 00000100:00100000:0.0:1783137787.493025:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299405824 00000100:00100000:0.0:1783137787.493065:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:0.0:1783137787.493073:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299405824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137787.493127:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299405824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 54us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137787.493135:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00080000:2.0:1783137787.493797:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137787.583471:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322506624:0@lo:400:kworker.0 00000100:00100000:2.0:1783137787.583575:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137787.583635:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322506496:0@lo:400:kworker.0 00000100:00100000:0.0:1783137787.583669:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137787.583763:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506496 00000100:00100000:2.0:1783137787.583771:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506496 00000100:00100000:2.0:1783137787.583830:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783137787.583850:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322506496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137787.583904:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322506496:12345-0@lo:400:kworker.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137787.583910:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783137787.584000:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137787.584033:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322506496:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.585763:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322506368:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.585817:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137787.585877:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322506880:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.585902:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137787.585944:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783137787.585950:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322506240:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.585976:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137787.586012:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322506752:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.586032:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137787.586061:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506624 00000100:00100000:1.0:1783137787.586067:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506624 00000100:00100000:1.0:1783137787.586111:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506880 00000100:00100000:1.0:1783137787.586114:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506880 00000100:00100000:1.0:1783137787.586136:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137787.586144:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322506624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137787.586206:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506368 00000100:00100000:0.0:1783137787.586210:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506368 00000100:00100000:1.0:1783137787.586223:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322506624:12345-0@lo:400:kworker.0 Request processed in 80us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137787.586241:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783137787.586247:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506752 00000100:00100000:0.0:1783137787.586249:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506752 00000100:00100000:1.0:1783137787.586254:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137787.586260:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322506880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137787.586263:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137787.586268:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322506368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.586294:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322506880:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137787.586295:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322506368:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137787.586299:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783137787.586300:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137787.586311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783137787.586317:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322506752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.586321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322506240 00000100:00100000:1.0:1783137787.586324:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322506240 00000100:00100000:0.0:1783137787.586341:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322506752:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137787.586344:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783137787.586347:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783137787.586350:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322506240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.586376:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322506240:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137787.586381:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1783137787.586387:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137787.586390:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137787.586392:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137787.586417:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322506240:0@lo:400:kworker.0 00010000:00080000:0.0:1783137787.586418:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc8778000 x1869755322506624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137787.586428:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322506752:0@lo:400:kworker.0 00000100:00100000:1.0:1783137787.586435:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322506368:0@lo:400:kworker.0 00000100:00100000:0.0:1783137787.586440:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322506624:0@lo:400:kworker.0 00010000:00080000:1.0:1783137787.586443:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dd0a7bb80 x1869755322506880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137787.586450:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322506880:0@lo:400:kworker.0 00000100:00100000:2.0:1783137788.091036:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137788.091056:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322507008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137788.091131:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137788.091257:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507008 00000100:00100000:3.0:1783137788.091264:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507008 00000100:00100000:3.0:1783137788.091321:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137788.091331:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322507008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137788.091360:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137788.091412:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322507008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137788.091417:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783137788.091480:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433100 x1869755322507008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137788.091493:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322507008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137788.410846:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137789.434751:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137790.460272:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137790.652255:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322507136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137790.652440:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137790.652625:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507136 00000100:00100000:3.0:1783137790.652633:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507136 00000100:00100000:3.0:1783137790.652705:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137790.652716:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322507136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137790.652754:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137790.653267:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322507136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 551us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137790.653275:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783137790.653307:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137790.653445:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0140bb80 x1869755322507136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137790.653466:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322507136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137791.485377:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783137791.597639:0:9125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:3.0:1783137792.506631:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137792.614304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137792.614444:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406080 00000100:00100000:1.0:1783137792.614456:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406080 00000100:00100000:1.0:1783137792.614609:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:1.0:1783137792.614634:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299406080:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137792.614721:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299406080:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 89us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137792.614729:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:2.0:1783137792.615210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137792.615335:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406208 00000100:00100000:3.0:1783137792.615340:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406208 00000100:00100000:3.0:1783137792.615392:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1783137792.615400:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299406208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137792.615439:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299406208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137792.615445:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00080000:2.0:1783137792.615502:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137792.699294:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322507520:0@lo:400:kworker.0 00000100:00100000:0.0:1783137792.699367:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137792.699421:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137792.699428:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322507648:0@lo:400:kworker.0 00000100:00100000:0.0:1783137792.699454:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137792.699490:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507520 00000100:00100000:0.0:1783137792.699497:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507520 00000100:00100000:0.0:1783137792.699582:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137792.699592:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322507520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137792.699645:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322507520:12345-0@lo:400:kworker.0 Request processed in 55us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137792.699653:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137792.699676:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507648 00000100:00100000:0.0:1783137792.699679:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507648 00000100:00100000:0.0:1783137792.699707:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783137792.699713:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322507648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137792.699745:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322507648:12345-0@lo:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137792.699764:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783137792.699784:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137792.699789:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137792.699828:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322507648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137792.699842:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322507648:0@lo:400:kworker.0 00000100:00100000:0.0:1783137792.699867:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322507520:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700031:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322507392:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700062:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137792.700085:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322507904:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700104:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137792.700140:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783137792.700147:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322507264:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700179:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137792.700200:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322507776:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700220:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137792.700244:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507392 00000100:00100000:2.0:1783137792.700249:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507392 00000100:00100000:2.0:1783137792.700277:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507776 00000100:00100000:2.0:1783137792.700280:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507776 00000100:00100000:2.0:1783137792.700299:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783137792.700305:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322507392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700338:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322507392:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137792.700344:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783137792.700356:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783137792.700362:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322507776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700388:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322507776:12345-0@lo:400:kworker.0 Request processed in 26us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137792.700393:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783137792.700408:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507904 00000100:00100000:2.0:1783137792.700411:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507904 00000100:00100000:2.0:1783137792.700433:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137792.700439:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322507904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700464:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322507904:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137792.700469:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137792.700484:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322507264 00000100:00100000:2.0:1783137792.700486:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322507264 00000100:00100000:2.0:1783137792.700505:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783137792.700511:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322507264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700535:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322507264:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137792.700541:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1783137792.700593:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137792.700602:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137792.700623:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322507264:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700634:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322507776:0@lo:400:kworker.0 00000100:00100000:2.0:1783137792.700643:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322507392:0@lo:400:kworker.0 00010000:00080000:2.0:1783137792.700653:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc8779c00 x1869755322507904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137792.700662:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322507904:0@lo:400:kworker.0 00000100:00100000:2.0:1783137793.211791:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137793.211816:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322508032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137793.211893:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137793.213680:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508032 00000100:00100000:3.0:1783137793.213693:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508032 00000100:00100000:3.0:1783137793.213765:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783137793.213777:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322508032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137793.213817:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137793.213889:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322508032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137793.213896:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1783137793.214005:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01430380 x1869755322508032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137793.214025:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322508032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137793.538033:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137794.555222:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137795.578778:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137795.794593:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137795.794629:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322508160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137795.794709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137795.794943:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508160 00000100:00100000:3.0:1783137795.794951:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508160 00000100:00100000:3.0:1783137795.795024:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783137795.795034:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322508160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137795.795069:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137795.795146:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322508160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137795.795153:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1783137795.795225:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783137795.795257:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0140b480 x1869755322508160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137795.795276:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322508160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137796.602685:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137797.501369:0:9224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:1.0:1783137797.633898:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137797.738154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137797.738198:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406336 00000100:00100000:1.0:1783137797.738208:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406336 00000100:00100000:1.0:1783137797.738264:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:1.0:1783137797.738274:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299406336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137797.738351:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299406336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.738359:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:2.0:1783137797.758881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137797.759806:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406464 00000100:00100000:3.0:1783137797.759818:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406464 00000100:00100000:3.0:1783137797.759882:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1783137797.759892:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299406464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137797.759963:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299406464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 73us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137797.759970:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00080000:2.0:1783137797.760066:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137797.830775:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322508288:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.830849:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.830897:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322508800:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.830925:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.830949:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783137797.830955:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322508416:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.830975:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.830990:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322508928:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.831012:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.831036:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322508544:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.831073:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.831123:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137797.831129:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322508672:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.831149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137797.831176:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508928 00000100:00100000:1.0:1783137797.831182:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508928 00000100:00100000:1.0:1783137797.834645:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508672 00000100:00100000:1.0:1783137797.834764:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508672 00000100:00100000:1.0:1783137797.834800:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137797.834811:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322508928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.834897:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322508928:12345-0@lo:400:kworker.0 Request processed in 88us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.834903:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137797.834921:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137797.834927:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322508672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.834957:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322508672:12345-0@lo:400:kworker.0 Request processed in 31us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.834963:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137797.834987:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508800 00000100:00100000:1.0:1783137797.834990:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508800 00000100:00100000:1.0:1783137797.835012:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508416 00000100:00100000:1.0:1783137797.835014:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508416 00000100:00100000:1.0:1783137797.835024:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508544 00000100:00100000:1.0:1783137797.835027:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508544 00000100:00100000:1.0:1783137797.835040:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1783137797.835182:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137797.835196:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137797.835199:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137797.835886:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322508800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.835931:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322508800:12345-0@lo:400:kworker.0 Request processed in 886us (5005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.835938:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137797.835966:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137797.835974:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322508416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.836003:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322508416:12345-0@lo:400:kworker.0 Request processed in 31us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.836009:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137797.836019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137797.836026:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322508544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.839497:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322508544:12345-0@lo:400:kworker.0 Request processed in 3463us (8415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137797.839510:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137797.839592:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322508416:0@lo:400:kworker.0 00010000:00080000:1.0:1783137797.839607:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01409c00 x1869755322508928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137797.839617:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322508928:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.839630:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322508800:0@lo:400:kworker.0 00010000:00080000:1.0:1783137797.840283:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0140a300 x1869755322508672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137797.840294:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322508672:0@lo:400:kworker.0 00000100:00100000:1.0:1783137797.840307:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322508544:0@lo:400:kworker.0 00000100:00100000:2.0:1783137797.841212:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322508288 00000100:00100000:2.0:1783137797.841221:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322508288 00000100:00100000:2.0:1783137797.841270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783137797.841279:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322508288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137797.841355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322508288:12345-0@lo:400:kworker.0 Request processed in 77us (10505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137797.841362:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783137797.843896:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322508288:0@lo:400:kworker.0 00000100:00100000:1.0:1783137798.331133:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137798.331216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137798.331454:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509056 00000100:00100000:3.0:1783137798.331468:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509056 00000100:00100000:3.0:1783137798.331598:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783137798.331612:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137798.331664:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137798.331762:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137798.331771:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1783137798.331866:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432d80 x1869755322509056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137798.331891:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137798.652850:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137799.674962:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137800.698682:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137800.891091:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137800.891132:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137800.891226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137800.891310:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509184 00000100:00100000:1.0:1783137800.891319:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509184 00000100:00100000:1.0:1783137800.891385:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137800.891396:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137800.891446:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137800.891496:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137800.891503:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783137800.891527:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137800.891589:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0140b100 x1869755322509184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137800.891613:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509184:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783137800.951975:0:9322:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:3.0:1783137801.723771:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137802.748736:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137802.855751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137802.855790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137802.856164:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406592 00000100:00100000:1.0:1783137802.856173:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406592 00000100:00100000:3.0:1783137802.856221:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406720 00000100:00100000:1.0:1783137802.856223:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:3.0:1783137802.856229:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406720 00000100:00100000:1.0:1783137802.856235:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299406592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137802.856291:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00080000:0.0:1783137802.856298:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137802.856304:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299406720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137802.856310:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299406592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 75us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137802.856319:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:3.0:1783137802.856347:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299406720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137802.856356:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:2.0:1783137802.938829:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322509440:0@lo:400:kworker.0 00000100:00100000:3.0:1783137802.938841:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322509568:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.939000:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322509312:0@lo:400:kworker.0 00000100:00100000:3.0:1783137802.942434:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137802.942517:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137802.942529:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509696:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.942824:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137802.942869:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322509824:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.942982:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137802.943010:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137802.943020:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322509952:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.943066:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137802.943118:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137802.943123:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509312 00000100:00100000:1.0:1783137802.943131:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509312 00000100:00100000:2.0:1783137802.943162:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509568 00000100:00100000:2.0:1783137802.943167:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509568 00000100:00100000:1.0:1783137802.943181:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783137802.943193:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137802.943208:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509824 00000100:00100000:2.0:1783137802.943213:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509824 00000100:00100000:2.0:1783137802.943229:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509440 00000100:00100000:2.0:1783137802.943231:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509440 00000100:00100000:2.0:1783137802.943249:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137802.943254:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322509312:12345-0@lo:400:kworker.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137802.943260:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322509568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.943267:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783137802.943307:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509952 00000100:00100000:2.0:1783137802.943308:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322509568:12345-0@lo:400:kworker.0 Request processed in 49us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137802.943313:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509952 00000100:00100000:2.0:1783137802.943319:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783137802.943338:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137802.943344:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137802.943370:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322509824:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137802.943376:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137802.943386:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783137802.943392:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322509440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137802.943423:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322509440:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137802.943429:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1783137802.943455:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137802.943461:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137802.943476:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137802.943493:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322509440:0@lo:400:kworker.0 00000100:00100000:3.0:1783137802.943511:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322509568:0@lo:400:kworker.0 00000100:00100000:3.0:1783137802.943649:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322509696 00000100:00100000:3.0:1783137802.943654:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322509696 00000100:00100000:3.0:1783137802.943697:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783137802.943703:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137802.943706:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137802.943760:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322509696:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137802.943768:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783137802.943844:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01431180 x1869755322509696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137802.943855:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322509696:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.944016:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783137802.944026:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322509952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.944082:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322509952:12345-0@lo:400:kworker.0 Request processed in 58us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137802.944090:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1783137802.944452:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01430e00 x1869755322509952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137802.944463:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322509952:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.944472:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322509312:0@lo:400:kworker.0 00000100:00100000:1.0:1783137802.944481:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322509824:0@lo:400:kworker.0 00000001:02000400:2.0:1783137803.335129:0:9370:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jul 4 00:03:20 EDT 2026 00000100:00100000:0.0:1783137803.450653:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137803.450675:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137803.450743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137803.450806:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510080 00000100:00100000:0.0:1783137803.450813:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510080 00000100:00100000:0.0:1783137803.451075:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783137803.451086:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137803.451124:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137803.451183:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137803.451204:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783137803.451244:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc8779c00 x1869755322510080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137803.451260:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc8779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137803.770736:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137804.796906:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137805.821834:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137806.013393:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137806.013471:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137806.013523:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510208 00000100:00100000:1.0:1783137806.013560:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510208 00000100:00080000:2.0:1783137806.013660:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137806.013683:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137806.013694:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137806.013733:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137806.013794:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (322us total) trans 0 rc 0/0 00010000:00080000:3.0:1783137806.013824:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01409c00 x1869755322510208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137806.013845:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137806.014755:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1783137806.843058:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137807.869887:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137807.978668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137807.978712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137807.978730:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406848 00000100:00100000:0.0:1783137807.978740:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406848 00000100:00100000:0.0:1783137807.978795:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:3.0:1783137807.978801:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299406976 00000100:00100000:3.0:1783137807.978806:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299406976 00000100:00100000:0.0:1783137807.978806:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299406848:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137807.978884:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2352:x1869755299406848:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137807.978892:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:3.0:1783137807.979207:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:3.0:1783137807.979216:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299406976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137807.979257:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299406976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137807.979264:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00080000:2.0:1783137807.979592:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137808.059387:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510720:0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.059567:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322510592:0@lo:400:kworker.0 00000100:00100000:1.0:1783137808.059613:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322510336:0@lo:400:kworker.0 00000100:00100000:2.0:1783137808.059688:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322510464:0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.062855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137808.062977:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510592 00000100:00100000:0.0:1783137808.062987:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510592 00000100:00100000:2.0:1783137808.063073:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137808.063076:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783137808.063087:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322510592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137808.063110:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322510976:0@lo:400:kworker.0 00000100:00100000:2.0:1783137808.063148:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137808.063150:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322510592:12345-0@lo:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137808.063157:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783137808.063172:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510464 00000100:00100000:0.0:1783137808.063174:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510464 00000100:00100000:2.0:1783137808.063184:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510976 00000100:00100000:2.0:1783137808.063187:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510976 00000100:00100000:0.0:1783137808.063194:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783137808.063199:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322510464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137808.063213:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783137808.063220:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322510976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.063227:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322510464:12345-0@lo:400:kworker.0 Request processed in 29us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137808.063247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783137808.063248:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322510976:12345-0@lo:400:kworker.0 Request processed in 29us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137808.063252:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1783137808.063269:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137808.063273:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137808.063294:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322510464:0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.063294:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322510592:0@lo:400:kworker.0 00010000:00080000:2.0:1783137808.063306:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433b80 x1869755322510976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137808.063315:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322510976:0@lo:400:kworker.0 00000100:00100000:3.0:1783137808.063622:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137808.063698:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137808.063733:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322510848:0@lo:400:kworker.0 00000100:00100000:1.0:1783137808.063759:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137808.064030:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510720 00000100:00100000:2.0:1783137808.064036:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510720 00000100:00100000:0.0:1783137808.064242:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510336 00000100:00100000:0.0:1783137808.064247:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510336 00000100:00100000:2.0:1783137808.064266:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137808.064272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783137808.064274:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.064277:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322510336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137808.064314:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322510720:12345-0@lo:400:kworker.0 Request processed in 42us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137808.064314:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322510336:12345-0@lo:400:kworker.0 Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137808.064321:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137808.064321:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1783137808.064346:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137808.064352:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322510848 00000100:00100000:0.0:1783137808.064355:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322510848 00000100:00100000:1.0:1783137808.064377:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322510336:0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.064379:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137808.064385:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322510848:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783137808.064469:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783137808.064503:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433480 x1869755322510720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137808.064514:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322510720:0@lo:400:kworker.0 00000100:00100000:0.0:1783137808.064623:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322510848:12345-0@lo:400:kworker.0 Request processed in 237us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137808.064629:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137808.064655:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322510848:0@lo:400:kworker.0 00000100:00100000:3.0:1783137808.571731:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137808.571753:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322511104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137808.571811:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137808.571888:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511104 00000100:00100000:0.0:1783137808.571895:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511104 00000100:00100000:0.0:1783137808.571953:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783137808.571964:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322511104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137808.571997:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137808.572170:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322511104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137808.572181:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1783137808.572233:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bef100 x1869755322511104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137808.572251:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322511104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137808.890758:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137809.916373:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137810.943442:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137811.136195:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322511232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137811.136267:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137811.137656:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511232 00000100:00100000:0.0:1783137811.141823:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511232 00000100:00080000:0.0:1783137811.141916:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137811.141991:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783137811.142005:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322511232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137811.142049:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137811.147042:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322511232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5028us (10760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137811.147062:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783137811.148092:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0140bb80 x1869755322511232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137811.148117:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322511232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137811.969012:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137812.986650:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137813.089884:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137813.090000:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407104 00000100:00100000:2.0:1783137813.090011:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407104 00000100:00100000:2.0:1783137813.090069:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:2.0:1783137813.090078:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299407104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137813.090165:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299407104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137813.090174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:0.0:1783137813.095037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137813.095194:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407232 00000100:00100000:2.0:1783137813.095202:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407232 00000100:00100000:2.0:1783137813.095276:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1783137813.095287:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299407232:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137813.095376:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299407232:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137813.095401:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00080000:0.0:1783137813.096139:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137813.179925:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322511616:0@lo:400:kworker.0 00000100:00100000:1.0:1783137813.180014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137813.180169:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137813.180177:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322511744:0@lo:400:kworker.0 00000100:00100000:1.0:1783137813.180205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137813.181180:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322511360:0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.181223:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137813.181315:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322511488:0@lo:400:kworker.0 00000100:00100000:2.0:1783137813.181348:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137813.189202:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511616 00000100:00100000:0.0:1783137813.189218:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511616 00000100:00100000:0.0:1783137813.189310:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511488 00000100:00100000:0.0:1783137813.189314:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511488 00000100:00100000:0.0:1783137813.189351:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137813.189362:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322511616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137813.198228:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322511616:12345-0@lo:400:kworker.0 Request processed in 8857us (18203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137813.198244:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137813.198293:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783137813.198310:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322511488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137813.198392:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322511488:12345-0@lo:400:kworker.0 Request processed in 91us (17043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137813.198417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1783137813.198447:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137813.198490:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322511616:0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.198760:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511360 00000100:00100000:3.0:1783137813.198768:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511360 00000100:00100000:3.0:1783137813.198820:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783137813.198828:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322511360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.198866:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322511360:12345-0@lo:400:kworker.0 Request processed in 39us (17642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137813.198872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783137813.198913:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322511360:0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.198924:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322511872:0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.198958:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137813.201715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511872 00000100:00100000:2.0:1783137813.201734:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511872 00000100:00100000:2.0:1783137813.201819:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137813.201830:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137813.201929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322511872:12345-0@lo:400:kworker.0 Request processed in 100us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137813.201937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137813.201979:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322511744 00000100:00100000:2.0:1783137813.201983:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322511744 00000100:00100000:2.0:1783137813.202016:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783137813.202023:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137813.202071:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322511744:12345-0@lo:400:kworker.0 Request processed in 38us (21854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137813.202077:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783137813.202448:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322511488:0@lo:400:kworker.0 00000100:00100000:2.0:1783137813.202460:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322512000:0@lo:400:kworker.0 00000100:00100000:2.0:1783137813.202494:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783137813.202779:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137813.202785:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137813.202794:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512000 00000100:00100000:3.0:1783137813.202798:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512000 00000100:00100000:3.0:1783137813.202844:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137813.202853:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322512000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.202894:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322512000:12345-0@lo:400:kworker.0 Request processed in 43us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137813.202899:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783137813.202930:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110df80 x1869755322512000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137813.202940:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322512000:0@lo:400:kworker.0 00000100:00100000:3.0:1783137813.202961:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322511872:0@lo:400:kworker.0 00010000:00080000:0.0:1783137813.203125:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f89180 x1869755322511744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137813.203136:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322511744:0@lo:400:kworker.0 00000100:00080000:2.0:1783137813.204660:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137813.694038:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137813.694066:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322512128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137813.694152:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137813.694237:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512128 00000100:00100000:0.0:1783137813.694245:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512128 00000100:00100000:0.0:1783137813.694293:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783137813.694303:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322512128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137813.694345:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137813.694391:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322512128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137813.694399:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783137813.694444:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110d500 x1869755322512128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137813.694464:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322512128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137814.010768:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137815.034906:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137816.069905:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137816.253202:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137816.253227:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322512256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137816.253312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137816.253436:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512256 00000100:00100000:1.0:1783137816.253449:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512256 00000100:00100000:1.0:1783137816.253512:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137816.253525:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322512256:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783137816.253643:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783137816.253752:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137816.257382:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322512256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3849us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137816.257397:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1783137816.263171:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216ce00 x1869755322512256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137816.263199:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322512256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137817.090830:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137818.108039:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137818.209881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137818.209918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137818.210023:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407488 00000100:00100000:2.0:1783137818.210057:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407488 00000100:00100000:2.0:1783137818.210137:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1783137818.210147:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299407488:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137818.210225:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299407488:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137818.210232:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00080000:1.0:1783137818.210401:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137818.210442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407360 00000100:00100000:0.0:1783137818.210446:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407360 00000100:00100000:0.0:1783137818.210475:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:0.0:1783137818.210485:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299407360:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137818.210507:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299407360:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 22us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137818.210511:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:2.0:1783137818.298812:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137818.299527:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322512512:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.299635:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137818.299758:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322512384:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.299789:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137818.299992:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322512768:0@lo:400:kworker.0 00000100:00100000:0.0:1783137818.300024:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137818.300044:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137818.300049:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322512640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137818.300081:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137818.300142:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512384 00000100:00100000:1.0:1783137818.300149:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512384 00000100:00100000:1.0:1783137818.300206:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783137818.300215:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322512384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137818.300267:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322512384:12345-0@lo:400:kworker.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137818.300274:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783137818.300568:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512768 00000100:00100000:2.0:1783137818.300573:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512768 00000100:00100000:2.0:1783137818.300620:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783137818.300627:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322512768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.300666:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322512768:12345-0@lo:400:kworker.0 Request processed in 39us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137818.300673:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783137818.300699:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322513024:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.300745:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137818.300781:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322512384:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.300798:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137818.300803:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322512896:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.300853:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513024 00000100:00100000:2.0:1783137818.300857:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513024 00000100:00100000:2.0:1783137818.300883:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783137818.300890:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.300939:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322513024:12345-0@lo:400:kworker.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137818.300953:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1783137818.301034:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137818.301039:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783137818.301398:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110fb80 x1869755322512768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137818.301413:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322512768:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.301522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137818.301608:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512512 00000100:00100000:3.0:1783137818.301614:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512512 00000100:00100000:1.0:1783137818.301668:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512640 00000100:00100000:1.0:1783137818.301672:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512640 00000100:00100000:1.0:1783137818.301711:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137818.301719:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322512512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137818.301763:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322512512:12345-0@lo:400:kworker.0 Request processed in 46us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137818.301770:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137818.301784:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137818.301790:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322512640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137818.301822:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322512640:12345-0@lo:400:kworker.0 Request processed in 32us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137818.301837:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137818.301870:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322512640:0@lo:400:kworker.0 00000100:00080000:0.0:1783137818.301941:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783137818.302011:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e0110f800 x1869755322513024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137818.302021:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322513024:0@lo:400:kworker.0 00000100:00100000:2.0:1783137818.302031:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322512512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137818.302098:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322512896 00000100:00100000:0.0:1783137818.302102:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322512896 00000100:00100000:0.0:1783137818.302205:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137818.302213:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322512896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137818.302250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322512896:12345-0@lo:400:kworker.0 Request processed in 39us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137818.302257:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137818.302281:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322512896:0@lo:400:kworker.0 00000100:00080000:1.0:1783137818.302727:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137818.811048:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322513152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137818.811127:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137818.811779:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513152 00000100:00100000:0.0:1783137818.811787:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513152 00000100:00100000:0.0:1783137818.811845:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137818.811854:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322513152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137818.811903:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137818.812016:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322513152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137818.812023:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1783137818.814095:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5bec700 x1869755322513152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137818.814126:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322513152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137819.135134:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137820.138566:0:9999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:03:37 (1783137817) === 00010000:00010000:1.0:1783137820.156172:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137820.596086:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137820.597430:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407616 00000100:00100000:3.0:1783137820.597444:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407616 00000100:00100000:3.0:1783137820.597536:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:3.0:1783137820.597635:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:8113:x1869755299407616:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783137820.597652:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137820.597671:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b7098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239224f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137820.597701:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b7098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224f5 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137820.597711:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b7098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224f5 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137820.597738:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7e00, rc 0) 00000100:00100000:3.0:1783137820.598093:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299407616:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 546us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.598100:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:0.0:1783137820.602354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.602520:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407744 00000100:00100000:1.0:1783137820.602538:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407744 00000100:00100000:1.0:1783137820.602675:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:1.0:1783137820.602688:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299407744:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783137820.603521:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299407744:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 833us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.603531:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:2.0:1783137820.628114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.628275:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299407872 00000100:00100000:1.0:1783137820.628285:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299407872 00000100:00100000:1.0:1783137820.628956:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 213 00000100:00100000:1.0:1783137820.628966:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299407872:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783137820.629486:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299407872:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 518us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.629496:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 213 00000100:00100000:0.0:1783137820.644151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.644283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408000 00000100:00100000:1.0:1783137820.644369:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408000 00000100:00100000:1.0:1783137820.644510:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 214 00000100:00100000:1.0:1783137820.644522:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8117:x1869755299408000:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137820.645353:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8117:x1869755299408000:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 761us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.645374:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 214 00000100:00100000:0.0:1783137820.671591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.671714:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408128 00000100:00100000:1.0:1783137820.671730:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408128 00000100:00100000:1.0:1783137820.672251:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:1.0:1783137820.672266:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8117:x1869755299408128:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137820.672631:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8117:x1869755299408128:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 368us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.672640:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:2.0:1783137820.676770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.676971:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408256 00000100:00100000:1.0:1783137820.676981:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408256 00000100:00100000:1.0:1783137820.677043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:1.0:1783137820.677053:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:8113:x1869755299408256:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783137820.677072:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137820.677090:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b709f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392251f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.677124:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b709f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392251f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.677256:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b709f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392251f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.677266:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d000, rc 0) 00000100:00100000:1.0:1783137820.677580:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:8113:x1869755299408256:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 449us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.677590:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:2.0:1783137820.689659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137820.689806:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408384 00000100:00100000:0.0:1783137820.689817:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408384 00000100:00100000:0.0:1783137820.689879:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:0.0:1783137820.689888:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:8113:x1869755299408384:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783137820.689924:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783137820.689951:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783137820.689955:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783137820.689958:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783137820.689960:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783137820.700297:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:8113:x1869755299408384:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 10394us (10632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.700317:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:2.0:1783137820.705657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.705786:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408512 00000100:00100000:1.0:1783137820.705801:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408512 00000100:00100000:1.0:1783137820.705880:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:1.0:1783137820.705892:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:8113:x1869755299408512:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783137820.705925:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137820.705949:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922526 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.705983:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.705995:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137820.706012:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6dc00, rc 0) 00000100:00100000:1.0:1783137820.706088:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8113:x1869755299408512:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 198us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.706095:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:2.0:1783137820.708791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137820.708956:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408640 00000100:00100000:3.0:1783137820.708969:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408640 00000100:00100000:3.0:1783137820.709045:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:3.0:1783137820.709057:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8113:x1869755299408640:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783137820.709518:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8113:x1869755299408640:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 461us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.709528:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:2.0:1783137820.711861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137820.711998:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408768 00000100:00100000:0.0:1783137820.712017:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408768 00000100:00100000:0.0:1783137820.712083:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:0.0:1783137820.712095:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8113:x1869755299408768:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783137820.712400:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8113:x1869755299408768:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 306us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137820.712409:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:2.0:1783137820.719926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.720048:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299408896 00000100:00100000:1.0:1783137820.720063:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299408896 00000100:00100000:1.0:1783137820.720144:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:1.0:1783137820.720156:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8121:x1869755299408896:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137820.720892:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8121:x1869755299408896:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 732us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.720914:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:2.0:1783137820.732682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137820.732981:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409024 00000100:00100000:3.0:1783137820.733007:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409024 00000100:00100000:3.0:1783137820.733084:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:3.0:1783137820.733097:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8121:x1869755299409024:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137820.733441:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:8121:x1869755299409024:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 346us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.733450:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:2.0:1783137820.751493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137820.751574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137820.751719:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409152 00000100:00100000:1.0:1783137820.751732:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409152 00000100:00100000:1.0:1783137820.751799:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409536 00000100:00100000:1.0:1783137820.751801:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409536 00000100:00100000:1.0:1783137820.751853:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:1.0:1783137820.751865:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299409536:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137820.751979:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299409536:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 116us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.751986:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:1.0:1783137820.752011:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1783137820.752015:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1869755299409152:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783137820.752043:0:5813:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 59eaef08-1a40-49b6-b925-58fee4e19e35@192.168.202.24@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1783137820.752086:0:5813:0:(genops.c:1406:class_connect()) connect: client 59eaef08-1a40-49b6-b925-58fee4e19e35, cookie 0x4691dfc3d66b70ad 00000004:00100000:1.0:1783137820.752124:0:5813:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783137820.752475:0:5813:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783137820.752511:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2349:x1869755299409152:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 494us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137820.752519:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00080000:2.0:1783137820.753737:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137820.773706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137820.773771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137820.775230:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409408 00000100:00100000:0.0:1783137820.775251:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409408 00000100:00100000:0.0:1783137820.775381:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409280 00000100:00100000:0.0:1783137820.775385:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409280 00000100:00100000:0.0:1783137820.775444:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783137820.775455:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+7:8113:x1869755299409408:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783137820.775533:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783137820.775693:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+7:8113:x1869755299409408:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 238us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137820.775702:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783137820.775725:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:0.0:1783137820.775732:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:0:x1869755299409280:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783137820.775745:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783137820.775769:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:0:x1869755299409280:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 37us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137820.775776:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00080000:2.0:1783137820.776436:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137820.781272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137820.781393:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409664 00000100:00100000:0.0:1783137820.781406:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409664 00000100:00100000:0.0:1783137820.781494:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783137820.781506:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:8113:x1869755299409664:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783137820.781678:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:8113:x1869755299409664:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 174us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137820.781687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1783137820.784397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137820.784895:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409792 00000100:00100000:0.0:1783137820.784917:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409792 00000100:00100000:0.0:1783137820.784980:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:0.0:1783137820.784989:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299409792:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783137820.785143:0:6616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 59eaef08-1a40-49b6-b925-58fee4e19e35@192.168.202.24@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1783137820.785189:0:6616:0:(genops.c:1406:class_connect()) connect: client 59eaef08-1a40-49b6-b925-58fee4e19e35, cookie 0x4691dfc3d66b70b4 00002000:00100000:0.0:1783137820.785224:0:6616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 59eaef08-1a40-49b6-b925-58fee4e19e35/ffff8e5df5967000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783137820.785259:0:6616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783137820.785968:0:6616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783137820.786366:0:6616:0:(import.c:65:import_set_state_nolock()) ffff8e5df5964000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137820.786479:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2349:x1869755299409792:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 1487us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137820.786490:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1783137820.788709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137820.788828:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299409920 00000100:00100000:3.0:1783137820.788841:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299409920 00000100:00100000:3.0:1783137820.788907:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1783137820.788928:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1869755299409920:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783137820.788974:0:7801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 59eaef08-1a40-49b6-b925-58fee4e19e35@192.168.202.24@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1783137820.789029:0:7801:0:(genops.c:1406:class_connect()) connect: client 59eaef08-1a40-49b6-b925-58fee4e19e35, cookie 0x4691dfc3d66b70bb 00002000:00100000:3.0:1783137820.789046:0:7801:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 59eaef08-1a40-49b6-b925-58fee4e19e35/ffff8e5dff9db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137820.789078:0:7801:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137820.789389:0:7801:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137820.789427:0:7801:0:(import.c:65:import_set_state_nolock()) ffff8e5dff9db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137820.789769:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2349:x1869755299409920:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 842us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.789779:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783137820.791698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137820.792846:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410048 00000100:00100000:3.0:1783137820.792863:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410048 00000100:00100000:3.0:1783137820.792942:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1783137820.792954:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+6:8113:x1869755299410048:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783137820.793386:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783137820.793625:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+6:8113:x1869755299410048:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 672us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137820.793634:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00010000:00010000:0.0:1783137821.179234:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137821.371139:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322513280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137821.371253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137821.371477:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513280 00000100:00100000:1.0:1783137821.371498:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513280 00000100:00080000:3.0:1783137821.371645:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137821.371649:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783137821.371667:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322513280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137821.371704:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137821.381502:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322513280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9825us (10235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137821.381524:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783137821.386567:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433b80 x1869755322513280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137821.386611:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322513280:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1783137821.997326:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00010000:00010000:0.0:1783137822.206119:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783137822.472124:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00000001:00100000:0.0:1783137822.484432:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00010000:00010000:1.0:1783137823.227279:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137823.419047:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322513664:0@lo:400:kworker.0 00000100:00100000:1.0:1783137823.419168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137823.419245:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137823.419252:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322513792:0@lo:400:kworker.0 00000100:00100000:1.0:1783137823.419285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137823.419487:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322513536:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.419523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137823.419585:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322514048:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.419611:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137823.419676:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513664 00000100:00100000:1.0:1783137823.419686:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513664 00000100:00100000:0.0:1783137823.421786:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137823.421809:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322513408:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.421906:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137823.421952:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322513920:0@lo:400:kworker.0 00000100:00100000:3.0:1783137823.422092:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513408 00000100:00100000:3.0:1783137823.422103:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513408 00000100:00100000:3.0:1783137823.422168:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783137823.422180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322513408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137823.422248:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322513408:12345-0@lo:400:kworker.0 Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137823.422271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783137823.422397:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137823.422443:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322513408:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.422591:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513536 00000100:00100000:0.0:1783137823.422596:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513536 00000100:00100000:3.0:1783137823.422652:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513920 00000100:00100000:3.0:1783137823.422656:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513920 00000100:00100000:1.0:1783137823.422746:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783137823.422758:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322513664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137823.422779:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322513792 00000100:00100000:2.0:1783137823.422784:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322513792 00000100:00100000:1.0:1783137823.422814:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322513664:12345-0@lo:400:kworker.0 Request processed in 59us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137823.422816:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514048 00000100:00100000:2.0:1783137823.422818:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514048 00000100:00100000:1.0:1783137823.422821:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137823.422839:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783137823.422846:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322513792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.422874:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783137823.422893:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137823.422898:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322513792:12345-0@lo:400:kworker.0 Request processed in 53us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137823.422904:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137823.422936:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322513536:12345-0@lo:400:kworker.0 Request processed in 56us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137823.422942:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783137823.422962:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137823.422969:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322514048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.423008:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322514048:12345-0@lo:400:kworker.0 Request processed in 41us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137823.423013:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137823.423042:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322513536:0@lo:400:kworker.0 00010000:00080000:0.0:1783137823.423057:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7c380 x1869755322514048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137823.423067:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322514048:0@lo:400:kworker.0 00000100:00080000:0.0:1783137823.424624:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137823.424635:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137823.424639:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137823.424728:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f7f800 x1869755322513792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137823.424747:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322513792:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.424763:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322513664:0@lo:400:kworker.0 00000100:00100000:3.0:1783137823.446438:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783137823.446694:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322513920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137823.446842:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322513920:12345-0@lo:400:kworker.0 Request processed in 162us (24445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137823.446851:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783137823.446936:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322513920:0@lo:400:kworker.0 00000100:00100000:0.0:1783137823.932811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137823.932845:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322514176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137823.933151:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137823.933270:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514176 00000100:00100000:3.0:1783137823.933282:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514176 00000100:00100000:3.0:1783137823.933357:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783137823.933368:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322514176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137823.933420:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137823.933481:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322514176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137823.933489:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1783137823.933539:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff97b100 x1869755322514176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137823.933671:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322514176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137824.250786:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137825.275135:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137825.896629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137825.896683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137825.896722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137825.896752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137825.896779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137825.896831:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410688 00000100:00100000:2.0:1783137825.896844:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410688 00000100:00100000:0.0:1783137825.896975:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410560 00000100:00100000:0.0:1783137825.897000:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410560 00000100:00100000:0.0:1783137825.897080:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1783137825.897102:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410560:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137825.897203:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410560:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 104us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137825.897212:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00080000:0.0:1783137825.897237:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137825.897585:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:2.0:1783137825.897594:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410688:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137825.897629:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410688:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 37us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137825.897642:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:1.0:1783137825.897721:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410176 00000100:00100000:1.0:1783137825.897727:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410176 00000100:00100000:1.0:1783137825.897769:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 224 00000100:00100000:1.0:1783137825.897777:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299410176:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137825.897808:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299410176:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137825.897814:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 224 00000100:00100000:3.0:1783137825.898283:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410432 00000100:00100000:3.0:1783137825.898289:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410432 00000100:00100000:3.0:1783137825.898336:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410304 00000100:00100000:3.0:1783137825.898339:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410304 00000100:00100000:3.0:1783137825.898429:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:3.0:1783137825.898438:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410432:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137825.898491:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299410432:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 55us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137825.898498:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:3.0:1783137825.898512:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1783137825.898518:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299410304:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137825.898542:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299410304:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137825.898596:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00080000:0.0:1783137825.900171:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137825.900186:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783137826.298908:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137826.495466:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322514304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137826.495589:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137826.495931:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514304 00000100:00100000:3.0:1783137826.495941:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514304 00000100:00100000:3.0:1783137826.496022:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783137826.496035:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322514304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137826.496360:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137826.496442:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322514304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 409us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137826.496460:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1783137826.496753:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433100 x1869755322514304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783137826.496992:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137826.497353:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322514304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137827.323091:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783137827.679215:0:10198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783137828.348216:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137828.540756:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322514432:0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.540805:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322514688:0@lo:400:kworker.0 00000100:00100000:0.0:1783137828.540995:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322514560:0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.546092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137828.546592:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137828.546612:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322514816:0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.546697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137828.546764:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514688 00000100:00100000:1.0:1783137828.546775:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514688 00000100:00100000:1.0:1783137828.546863:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137828.546876:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322514688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.546953:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322514688:12345-0@lo:400:kworker.0 Request processed in 80us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137828.546961:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137828.546990:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514816 00000100:00100000:1.0:1783137828.546993:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514816 00000100:00100000:1.0:1783137828.547027:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783137828.547033:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322514816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.547067:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322514816:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137828.547073:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1783137828.547090:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137828.547096:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783137828.547137:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7c8000 x1869755322514816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137828.547153:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322514816:0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.547167:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322514688:0@lo:400:kworker.0 00000100:00100000:3.0:1783137828.547889:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137828.547947:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514432 00000100:00100000:3.0:1783137828.547954:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514432 00000100:00100000:3.0:1783137828.548002:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783137828.548012:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322514432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137828.549131:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137828.549179:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322515072:0@lo:400:kworker.0 00000100:00100000:3.0:1783137828.549235:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322514432:12345-0@lo:400:kworker.0 Request processed in 1222us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137828.549243:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137828.549251:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783137828.549292:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137828.549302:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322514944:0@lo:400:kworker.0 00000100:00100000:3.0:1783137828.549320:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514560 00000100:00100000:3.0:1783137828.549328:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514560 00000100:00100000:0.0:1783137828.549346:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137828.549372:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322514944 00000100:00100000:3.0:1783137828.549377:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322514944 00000100:00100000:0.0:1783137828.549393:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515072 00000100:00100000:0.0:1783137828.549399:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515072 00000100:00100000:3.0:1783137828.549431:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783137828.549443:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322514560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137828.549444:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137828.549458:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.549768:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783137828.549778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322514944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137828.552295:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322514560:12345-0@lo:400:kworker.0 Request processed in 2840us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137828.552312:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783137828.552414:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322514560:0@lo:400:kworker.0 00000100:00100000:0.0:1783137828.552521:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322515072:12345-0@lo:400:kworker.0 Request processed in 3063us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137828.552572:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1783137828.552616:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137828.552625:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783137828.552682:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7caa00 x1869755322515072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137828.552696:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322515072:0@lo:400:kworker.0 00000100:00100000:1.0:1783137828.553120:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322514944:12345-0@lo:400:kworker.0 Request processed in 3340us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137828.553137:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783137828.557718:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322514432:0@lo:400:kworker.0 00000100:00100000:0.0:1783137828.557898:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322514944:0@lo:400:kworker.0 00000100:00100000:2.0:1783137829.051793:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137829.051839:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322515200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137829.052165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137829.052320:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515200 00000100:00100000:3.0:1783137829.052333:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515200 00000100:00100000:3.0:1783137829.052416:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137829.052428:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322515200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137829.052491:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137829.052585:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322515200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137829.052594:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783137829.052701:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432300 x1869755322515200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137829.052726:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322515200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137829.374354:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137830.401269:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137831.009082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137831.009122:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137831.009162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137831.009197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137831.009226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137831.009257:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410944 00000100:00100000:0.0:1783137831.009258:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299410816 00000100:00100000:0.0:1783137831.009267:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410816 00000100:00100000:2.0:1783137831.009268:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299410944 00000100:00100000:0.0:1783137831.009328:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:2.0:1783137831.009338:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411072 00000100:00100000:0.0:1783137831.009340:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299410816:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137831.009353:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411072 00000100:00100000:2.0:1783137831.009379:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:2.0:1783137831.009389:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299410944:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137831.009450:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299410816:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137831.009458:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:3.0:1783137831.009481:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:3.0:1783137831.009493:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411072:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137831.009586:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411200 00000100:00100000:1.0:1783137831.009591:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411200 00000100:00100000:1.0:1783137831.009622:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411328 00000100:00100000:1.0:1783137831.009625:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411328 00000100:00100000:1.0:1783137831.009660:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1783137831.009667:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411200:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137831.010492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299410944:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1101us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137831.010512:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:2.0:1783137831.010565:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1783137831.010576:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411328:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137831.010629:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411328:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 56us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137831.010637:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00080000:2.0:1783137831.010671:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137831.010675:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137831.010678:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137831.011027:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411072:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1536us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137831.011043:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:1.0:1783137831.011308:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299411200:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1640us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137831.011317:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00010000:00010000:0.0:1783137831.418958:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137831.611349:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322515328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137831.611436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137831.611776:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515328 00000100:00100000:3.0:1783137831.611787:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515328 00000100:00100000:3.0:1783137831.611860:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137831.611872:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322515328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137831.611909:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137831.611959:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322515328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137831.611967:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783137831.612054:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137831.612086:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432a00 x1869755322515328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137831.612105:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322515328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137832.443133:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137833.468660:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137833.662866:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137833.663013:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322515584:0@lo:400:kworker.0 00000100:00100000:1.0:1783137833.663084:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137833.663170:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322515456:0@lo:400:kworker.0 00000100:00100000:1.0:1783137833.663203:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137833.663734:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515456 00000100:00100000:1.0:1783137833.663742:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515456 00000100:00100000:1.0:1783137833.663803:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783137833.663814:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322515456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137833.663870:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322515456:12345-0@lo:400:kworker.0 Request processed in 58us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137833.663877:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783137833.663923:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322515456:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.665563:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515584 00000100:00100000:0.0:1783137833.665574:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515584 00000100:00100000:0.0:1783137833.665623:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783137833.665633:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322515584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.665707:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322515584:12345-0@lo:400:kworker.0 Request processed in 76us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137833.665714:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783137833.672453:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322515712:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.672532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137833.672685:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137833.672692:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322515840:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.672718:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137833.672754:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515840 00000100:00100000:0.0:1783137833.672772:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515840 00000100:00100000:0.0:1783137833.672852:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137833.672862:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322515840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.672917:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322515840:12345-0@lo:400:kworker.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137833.672924:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783137833.672945:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137833.672955:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322515968:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.672980:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137833.673001:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137833.673006:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322516096:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673029:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137833.673056:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515712 00000100:00100000:0.0:1783137833.673060:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515712 00000100:00100000:0.0:1783137833.673087:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322515968 00000100:00100000:0.0:1783137833.673090:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322515968 00000100:00100000:0.0:1783137833.673106:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137833.673112:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322515712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673142:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322515712:12345-0@lo:400:kworker.0 Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137833.673148:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137833.673160:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137833.673166:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322515968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673194:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322515968:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137833.673199:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137833.673214:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516096 00000100:00100000:0.0:1783137833.673237:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516096 00000100:00100000:0.0:1783137833.673264:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137833.673269:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322516096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673297:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322516096:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137833.673303:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1783137833.673318:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137833.673321:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137833.673346:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432a00 x1869755322516096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137833.673359:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322516096:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673369:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322515968:0@lo:400:kworker.0 00010000:00080000:0.0:1783137833.673395:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432680 x1869755322515840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137833.673403:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322515840:0@lo:400:kworker.0 00000100:00100000:0.0:1783137833.673411:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322515712:0@lo:400:kworker.0 00000100:00100000:2.0:1783137833.674644:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322515584:0@lo:400:kworker.0 00000100:00100000:0.0:1783137834.172335:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322516224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137834.172409:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137834.172650:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516224 00000100:00100000:3.0:1783137834.172658:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516224 00000100:00100000:3.0:1783137834.172710:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137834.172720:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322516224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137834.172753:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137834.172826:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322516224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137834.172833:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783137834.172866:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432300 x1869755322516224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137834.172908:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322516224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137834.491650:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137835.515084:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137836.140095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137836.140130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137836.140157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137836.140176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137836.140199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137836.140225:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411584 00000100:00100000:1.0:1783137836.140235:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411584 00000100:00100000:1.0:1783137836.140289:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411712 00000100:00100000:1.0:1783137836.140293:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411712 00000100:00100000:1.0:1783137836.140316:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:1.0:1783137836.140326:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299411584:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137836.140398:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299411584:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137836.140405:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:1.0:1783137836.140422:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:1.0:1783137836.140428:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411712:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137836.140453:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411712:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137836.140459:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:1.0:1783137836.140476:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411840 00000100:00100000:1.0:1783137836.140479:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411840 00000100:00100000:1.0:1783137836.140503:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411968 00000100:00100000:1.0:1783137836.140506:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411968 00000100:00100000:1.0:1783137836.140540:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1783137836.140586:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411840:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137836.140616:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411840:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137836.140622:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1783137836.140634:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:1.0:1783137836.140640:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411968:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137836.140662:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299411968:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137836.140668:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:1.0:1783137836.140683:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299411456 00000100:00100000:1.0:1783137836.140686:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299411456 00000100:00100000:1.0:1783137836.140708:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:1.0:1783137836.140714:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299411456:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137836.140736:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299411456:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137836.140743:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00080000:1.0:1783137836.140772:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137836.140788:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137836.140790:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137836.541735:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137836.731107:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322516352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137836.731187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137836.731367:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516352 00000100:00100000:3.0:1783137836.731375:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516352 00000100:00100000:3.0:1783137836.731743:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783137836.731754:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322516352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137836.731809:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137836.731860:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322516352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137836.731867:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1783137836.731954:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433100 x1869755322516352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137836.731972:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322516352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783137836.733221:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137837.563923:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137838.592302:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137838.779090:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322516736:0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.779169:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137838.779224:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137838.779230:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322516864:0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.779254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137838.779286:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516736 00000100:00100000:1.0:1783137838.779292:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516736 00000100:00100000:1.0:1783137838.779351:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783137838.779362:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322516736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.779416:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322516736:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.779423:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783137838.779446:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516864 00000100:00100000:1.0:1783137838.779450:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516864 00000100:00100000:1.0:1783137838.779477:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137838.779484:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322516864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.779514:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322516864:12345-0@lo:400:kworker.0 Request processed in 31us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.779520:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783137838.779535:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137838.779539:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783137838.779587:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7c8380 x1869755322516864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137838.779600:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322516864:0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.779611:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322516736:0@lo:400:kworker.0 00000100:00100000:3.0:1783137838.779723:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322516608:0@lo:400:kworker.0 00000100:00100000:3.0:1783137838.779769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137838.779795:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322517120:0@lo:400:kworker.0 00000100:00100000:3.0:1783137838.779814:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137838.779834:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783137838.779839:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322516480:0@lo:400:kworker.0 00000100:00100000:3.0:1783137838.779874:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137838.779899:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322516992:0@lo:400:kworker.0 00000100:00100000:3.0:1783137838.779919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137838.780082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516608 00000100:00100000:1.0:1783137838.780087:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516608 00000100:00100000:1.0:1783137838.780123:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516992 00000100:00100000:1.0:1783137838.780126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516992 00000100:00100000:1.0:1783137838.780158:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783137838.780165:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322516608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780203:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322516608:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.780209:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783137838.780221:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137838.780227:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322516992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780252:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322516992:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.780259:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137838.780273:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517120 00000100:00100000:1.0:1783137838.780276:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517120 00000100:00100000:1.0:1783137838.780297:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137838.780303:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322517120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780345:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322517120:12345-0@lo:400:kworker.0 Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.780351:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137838.780368:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322516480 00000100:00100000:1.0:1783137838.780371:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322516480 00000100:00100000:1.0:1783137838.780395:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783137838.780402:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322516480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780432:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322516480:12345-0@lo:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137838.780438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783137838.780479:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322516480:0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780498:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322516992:0@lo:400:kworker.0 00000100:00100000:1.0:1783137838.780507:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322516608:0@lo:400:kworker.0 00010000:00080000:1.0:1783137838.780517:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7cb100 x1869755322517120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137838.780527:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322517120:0@lo:400:kworker.0 00000100:00080000:3.0:1783137838.780650:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137838.780654:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137839.291110:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322517248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137839.291182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137839.291362:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517248 00000100:00100000:0.0:1783137839.291370:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517248 00000100:00100000:0.0:1783137839.291455:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137839.291465:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322517248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137839.291515:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137839.291622:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322517248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137839.291638:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1783137839.291834:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433b80 x1869755322517248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137839.291854:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322517248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137839.610966:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137840.636032:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137841.249409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137841.249463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137841.249522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137841.249681:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412096 00000100:00100000:2.0:1783137841.249691:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412096 00000100:00100000:2.0:1783137841.249757:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 230 00000100:00100000:2.0:1783137841.249768:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299412096:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137841.249849:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299412096:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 83us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137841.249856:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 230 00000100:00100000:1.0:1783137841.249940:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412224 00000100:00100000:1.0:1783137841.249944:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412224 00000100:00100000:1.0:1783137841.249991:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412352 00000100:00100000:1.0:1783137841.249994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412352 00000100:00100000:1.0:1783137841.250014:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:1.0:1783137841.250021:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299412224:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137841.250052:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299412224:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137841.250059:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:1.0:1783137841.250072:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:1.0:1783137841.250077:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299412352:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137841.250098:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299412352:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137841.250117:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00080000:2.0:1783137841.250398:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137841.251684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137841.251722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137841.251851:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412480 00000100:00100000:3.0:1783137841.251859:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412480 00000100:00100000:3.0:1783137841.252038:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412608 00000100:00100000:3.0:1783137841.252042:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412608 00000100:00080000:0.0:1783137841.252089:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137841.252092:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137841.260512:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783137841.261240:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1783137841.261256:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2349:x1869755299412608:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:3.0:1783137841.261293:0:6615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b70bb 00000100:00080000:3.0:1783137841.261304:0:6615:0:(import.c:65:import_set_state_nolock()) ffff8e5dff9db000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137841.261598:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783137841.262131:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+2:2349:x1869755299412608:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 878us (10403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137841.262141:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783137841.262817:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2349:x1869755299412480:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:0.0:1783137841.262842:0:7801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b70b4 00000100:00080000:0.0:1783137841.262850:0:7801:0:(import.c:65:import_set_state_nolock()) ffff8e5df5964000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783137841.263028:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783137841.263076:0:7801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783137841.263435:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+2:2349:x1869755299412480:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 2908us (11754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137841.263444:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00010000:00010000:2.0:1783137841.264250:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137841.660064:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137841.852760:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137841.852848:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137841.853017:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517376 00000100:00100000:3.0:1783137841.853025:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517376 00000100:00100000:3.0:1783137841.853089:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783137841.853100:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322517376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137841.853143:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137841.853188:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322517376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137841.853195:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783137841.853299:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137841.853327:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433b80 x1869755322517376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137841.853345:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322517376:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1783137842.472866:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00000020:00000080:2.0:1783137842.472877:0:7522:0:(genops.c:906:class_export_put()) final put ffff8e5dff9db800/59eaef08-1a40-49b6-b925-58fee4e19e35 00000020:00000080:2.0:1783137842.472910:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9db800/59eaef08-1a40-49b6-b925-58fee4e19e35 for lustre-OST0001 00000020:00000080:2.0:1783137842.472960:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dff9db000 for lustre-OST0001 00010000:00010000:3.0:1783137842.682673:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137842.920869:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00000020:00000080:3.0:1783137842.920879:0:6642:0:(genops.c:906:class_export_put()) final put ffff8e5df5967000/59eaef08-1a40-49b6-b925-58fee4e19e35 00000020:00000080:0.0:1783137842.921289:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5967000/59eaef08-1a40-49b6-b925-58fee4e19e35 for lustre-OST0000 00000020:00000080:0.0:1783137842.921338:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5df5964000 for lustre-OST0000 00010000:00010000:2.0:1783137843.707770:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137843.898969:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137843.898992:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322517504:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899064:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.899149:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517504 00000100:00100000:1.0:1783137843.899156:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517504 00000100:00100000:1.0:1783137843.899202:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783137843.899210:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322517504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899260:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322517504:12345-0@lo:400:kworker.0 Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.899267:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783137843.899316:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322517504:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899351:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322517632:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899376:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.899417:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517632 00000100:00100000:1.0:1783137843.899428:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517632 00000100:00100000:1.0:1783137843.899453:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137843.899459:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322517632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899492:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322517632:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.899498:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137843.899523:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322517632:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899567:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137843.899575:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322517760:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.899631:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322517888:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.899707:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137843.899747:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322518016:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.899791:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517760 00000100:00100000:1.0:1783137843.899795:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517760 00000100:00100000:1.0:1783137843.899818:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518016 00000100:00100000:1.0:1783137843.899820:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518016 00000100:00100000:1.0:1783137843.899836:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783137843.899841:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899870:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322517760:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.899875:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783137843.899886:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783137843.899892:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899929:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322518016:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.899934:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1783137843.899949:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137843.899969:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322517760:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.899985:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322518016:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.900011:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322518144:0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.900031:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137843.900081:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322517888 00000100:00100000:1.0:1783137843.900085:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322517888 00000100:00100000:1.0:1783137843.900114:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518144 00000100:00100000:1.0:1783137843.900116:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518144 00000100:00100000:1.0:1783137843.900146:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137843.900153:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.900186:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322517888:12345-0@lo:400:kworker.0 Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.900192:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137843.900204:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137843.900209:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322518144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137843.900237:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322518144:12345-0@lo:400:kworker.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137843.900243:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1783137843.900258:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137843.900261:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137843.900277:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7c9c00 x1869755322517888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137843.900300:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322517888:0@lo:400:kworker.0 00010000:00080000:1.0:1783137843.900325:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfb0a6680 x1869755322518144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137843.900334:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322518144:0@lo:400:kworker.0 00000100:00100000:2.0:1783137844.414074:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322518272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137844.414148:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137844.414211:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518272 00000100:00100000:3.0:1783137844.414220:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518272 00000100:00100000:3.0:1783137844.414276:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783137844.414285:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322518272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137844.414321:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137844.414378:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322518272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137844.414385:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783137844.415919:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433100 x1869755322518272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137844.415942:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322518272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137844.744957:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137845.754691:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137846.369802:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137846.369918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137846.370117:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412736 00000100:00100000:2.0:1783137846.370128:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412736 00000100:00100000:2.0:1783137846.370187:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 232 00000100:00100000:2.0:1783137846.370198:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299412736:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137846.370292:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299412736:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 96us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137846.370300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 232 00000100:00100000:3.0:1783137846.370528:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412992 00000100:00100000:3.0:1783137846.370532:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412992 00000100:00100000:3.0:1783137846.370604:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:3.0:1783137846.370612:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299412992:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137846.370649:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299412992:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 40us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137846.370655:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00080000:2.0:1783137846.371120:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137846.372269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137846.372484:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299412864 00000100:00100000:2.0:1783137846.372494:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299412864 00000100:00100000:2.0:1783137846.372591:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:2.0:1783137846.372601:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299412864:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137846.372664:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299412864:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137846.372672:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00080000:1.0:1783137846.373287:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783137846.489163:0:10900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783137846.779832:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137846.972397:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322518400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137846.972492:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137846.972657:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518400 00000100:00100000:3.0:1783137846.972666:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518400 00000100:00100000:3.0:1783137846.972770:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783137846.972793:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322518400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137846.972864:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137846.972925:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322518400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137846.972933:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783137846.972980:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432300 x1869755322518400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137846.972998:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322518400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783137846.973292:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137847.803014:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137848.828175:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137849.018857:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322518528:0@lo:400:kworker.0 00000100:00100000:0.0:1783137849.018941:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137849.019057:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518528 00000100:00100000:3.0:1783137849.019066:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518528 00000100:00100000:3.0:1783137849.019130:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783137849.019141:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137849.019924:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322518656:0@lo:400:kworker.0 00000100:00100000:1.0:1783137849.019985:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137849.024965:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322518528:12345-0@lo:400:kworker.0 Request processed in 5815us (6013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137849.024981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783137849.025056:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518656 00000100:00100000:3.0:1783137849.025066:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518656 00000100:00100000:3.0:1783137849.025110:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137849.025128:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322518656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.025217:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322518656:12345-0@lo:400:kworker.0 Request processed in 99us (5231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137849.025224:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137849.025270:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322518656:0@lo:400:kworker.0 00000100:00100000:0.0:1783137849.026892:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322518528:0@lo:400:kworker.0 00000100:00100000:2.0:1783137849.028859:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322518784:0@lo:400:kworker.0 00000100:00100000:2.0:1783137849.028923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137849.029017:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322518912:0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029046:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137849.029093:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518912 00000100:00100000:3.0:1783137849.029111:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518912 00000100:00100000:3.0:1783137849.029208:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783137849.029216:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322518912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029264:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322518912:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137849.029271:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1783137849.029288:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783137849.029313:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01430e00 x1869755322518912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137849.029327:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322518912:0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029344:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322519168:0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029363:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137849.029398:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137849.029403:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322519040:0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029435:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519168 00000100:00100000:3.0:1783137849.029438:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519168 00000100:00100000:3.0:1783137849.029478:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783137849.029493:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322519168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137849.029525:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322519168:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137849.029530:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1783137849.029569:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137849.031701:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783137849.039930:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432680 x1869755322519168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137849.039952:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322519168:0@lo:400:kworker.0 00000100:00100000:1.0:1783137849.042655:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322518784 00000100:00100000:1.0:1783137849.042680:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322518784 00000100:00080000:0.0:1783137849.045660:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137849.046803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519040 00000100:00100000:2.0:1783137849.046816:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519040 00000100:00100000:2.0:1783137849.046883:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783137849.046894:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322518784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137849.046992:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322518784:12345-0@lo:400:kworker.0 Request processed in 100us (18068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137849.047000:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783137849.047019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137849.047026:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137849.047059:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322519040:12345-0@lo:400:kworker.0 Request processed in 34us (15365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137849.047065:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137849.047136:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322518784:0@lo:400:kworker.0 00000100:00080000:0.0:1783137849.047325:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137849.047430:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322519040:0@lo:400:kworker.0 00000100:00100000:0.0:1783137849.531041:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322519296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137849.531109:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137849.531184:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519296 00000100:00100000:0.0:1783137849.531191:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519296 00000100:00100000:0.0:1783137849.531233:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137849.531242:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322519296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137849.531280:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137849.531322:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322519296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137849.531329:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783137849.531369:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc216e680 x1869755322519296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137849.531387:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322519296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137849.853578:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137850.874748:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783137850.941960:0:11049:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd57414860 20000000:00000080:0.0:1783137850.941978:0:11049:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5dea322c00 uarg=0000000000000000 20000000:01000000:0.0:1783137850.942016:0:11049:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783137850.942022:0:11049:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783137850.942033:0:11049:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783137850.950189:0:11050:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783137850.950494:0:11049:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783137850.962729:0:11049:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783137850.962774:0:11049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962797:0:11049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962807:0:11049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962834:0:11049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962841:0:11049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962849:0:11049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962858:0:11049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962905:0:11049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.962922:0:11049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 12 pid: 5807 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.962938:0:11049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519424:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137850.963041:0:11049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.963049:0:11049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 18 pid: 5805 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.963059:0:11049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519552:0@lo:104: 00000100:00100000:1.0:1783137850.963103:0:11049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137850.963153:0:11049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.963167:0:11049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 18 pid: 5807 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.963176:0:11049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519680:0@lo:104: 00000100:00100000:1.0:1783137850.963199:0:11049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137850.963900:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519552 00000100:00100000:0.0:1783137850.963910:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519552 00000100:00100000:0.0:1783137850.963949:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519680 00000100:00100000:0.0:1783137850.963952:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519680 00000100:00100000:0.0:1783137850.963967:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137850.963974:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:11049:x1869755322519552:12345-0@lo:104: 00010000:00010000:0.0:1783137850.963988:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137850.964043:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137850.964049:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:11049:x1869755322519552:12345-0@lo:104: Request processed in 76us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137850.964055:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137850.964072:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137850.964078:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11049:x1869755322519680:12345-0@lo:104: 00010000:00010000:0.0:1783137850.964085:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137850.964114:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783137850.964119:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11049:x1869755322519680:12345-0@lo:104: Request processed in 42us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137850.964124:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783137850.964462:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137850.964469:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964476:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137850.964480:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964488:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137850.964504:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137850.964510:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137850.964578:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964585:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137850.964606:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964614:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030000/0x4691dfc3d66b708a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7091 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964628:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137850.964631:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964637:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137850.964639:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964645:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137850.964651:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137850.964667:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137850.964689:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964695:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137850.964711:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964718:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc0030400/0x4691dfc3d66b707c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7083 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964727:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137850.964728:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137850.964730:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137850.964736:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137850.964748:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322519808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137850.964787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137850.964830:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322519936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137850.964849:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137850.964877:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519808 00000100:00100000:2.0:1783137850.964882:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519808 00010000:00010000:2.0:1783137850.964902:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 19 pid: 5805 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.964922:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322519936 00000100:00100000:2.0:1783137850.964925:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322519936 00010000:00010000:2.0:1783137850.964936:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 20 pid: 5807 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.964951:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137850.964958:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3315:x1869755322519808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137850.964977:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137850.964982:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 20 pid: 5805 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.964992:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 20 pid: 5805 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.965007:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137850.965035:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3315:x1869755322519808:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137850.965041:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137850.965085:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137850.965091:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322519936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137850.965098:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137850.965101:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 19 pid: 5807 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.965109:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 19 pid: 5807 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.965118:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137850.965141:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322519936:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137850.965148:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137850.965188:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322519936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137850.965210:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322519808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137850.970228:0:11049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.970261:0:11049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 18 pid: 5806 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.970278:0:11049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322520064:0@lo:104: 00000100:00100000:2.0:1783137850.970342:0:11049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137850.970383:0:11049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.970392:0:11049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 12 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.970402:0:11049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322520192:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137850.970463:0:11049:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc24126c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783137850.970492:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4e00/0x4691dfc3d66b7091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b708a expref: 18 pid: 5805 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.970507:0:11049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519552:0@lo:104: 00010000:00010000:2.0:1783137850.970519:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b7083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b707c expref: 17 pid: 5807 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.970530:0:11049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519680:0@lo:104: 00000100:00100000:1.0:1783137850.970663:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520064 00000100:00100000:1.0:1783137850.970670:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520064 00000100:00100000:1.0:1783137850.970732:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137850.970743:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11049:x1869755322520064:12345-0@lo:104: 00010000:00010000:1.0:1783137850.970766:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970818:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137850.970825:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11049:x1869755322520064:12345-0@lo:104: Request processed in 84us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137850.970833:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783137850.970853:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137850.970859:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970866:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137850.970871:0:7510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970880:0:7510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137850.970889:0:7510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137850.970903:0:7510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137850.970931:0:7510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970938:0:7510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137850.970959:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970966:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685200/0x4691dfc3d66b706e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b7075 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.970983:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137850.970985:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137850.970987:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137850.971005:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322520320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137850.971033:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137850.971073:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520320 00000100:00100000:1.0:1783137850.971077:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520320 00010000:00010000:1.0:1783137850.971094:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 17 pid: 5806 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.971116:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137850.971122:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3317:x1869755322520320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137850.971132:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137850.971139:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 17 pid: 5806 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.971149:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 17 pid: 5806 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.971173:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137850.971200:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3317:x1869755322520320:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137850.971207:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137850.971235:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322520320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137850.973981:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684e00/0x4691dfc3d66b7075 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b706e expref: 16 pid: 5806 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.974007:0:11049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322520064:0@lo:104: 00000100:00100000:1.0:1783137850.975484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137850.975531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137850.975581:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413120 00000100:00100000:1.0:1783137850.975590:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413120 00010000:00010000:1.0:1783137850.975641:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 13 pid: 5807 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.975679:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413248 00000100:00100000:1.0:1783137850.975682:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413248 00010000:00010000:1.0:1783137850.975694:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 14 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137850.975712:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:1.0:1783137850.975720:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+14:2353:x1869755299413120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137850.975734:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137850.975740:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 14 pid: 5807 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975764:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 14 pid: 5807 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975783:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137850.975847:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+14:2353:x1869755299413120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 127us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137850.975854:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:1.0:1783137850.975870:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1783137850.975876:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299413248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137850.975884:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137850.975888:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 13 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975895:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 13 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975906:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975914:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975927:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975933:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975939:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975945:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975951:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137850.975959:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975968:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975976:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137850.975986:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137850.976002:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299413248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 127us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137850.976009:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00010000:00010000:2.0:1783137850.981866:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6dc00/0x4691dfc3d66b70a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922526 expref: 12 pid: 5807 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.981915:0:11049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322519424:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137850.981935:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5800/0x4691dfc3d66b7067 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224ee expref: 11 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137850.981945:0:11049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11049:1869755322520192:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137850.981990:0:11049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.982003:0:11049:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.982010:0:11049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137850.982017:0:11049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b70c2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137851.501512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137851.501609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137851.501645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137851.501697:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413632 00000100:00100000:3.0:1783137851.501708:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413632 00000100:00100000:3.0:1783137851.501790:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413504 00000100:00100000:3.0:1783137851.501794:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413504 00000100:00100000:3.0:1783137851.501819:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:3.0:1783137851.501847:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299413632:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137851.501859:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413376 00000100:00100000:2.0:1783137851.501864:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413376 00000100:00100000:2.0:1783137851.501891:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:2.0:1783137851.501897:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2353:x1869755299413376:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137851.501932:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299413632:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137851.501940:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:3.0:1783137851.501958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:3.0:1783137851.501964:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299413504:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:1.0:1783137851.502029:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137851.508939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2353:x1869755299413376:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 7022us (7419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137851.508959:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:3.0:1783137851.510124:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299413504:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 8147us (8465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137851.510138:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00010000:00010000:2.0:1783137851.902685:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137852.090875:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322520448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137852.090989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137852.091385:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520448 00000100:00100000:0.0:1783137852.091397:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520448 00000100:00100000:0.0:1783137852.091511:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783137852.091522:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322520448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137852.091601:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783137852.091791:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137852.091888:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322520448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.091897:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783137852.091961:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01432a00 x1869755322520448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137852.091981:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322520448:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1783137852.540610:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137852.540617:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5c0e000 from 7 10000000:01000000:1.0:1783137852.540623:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137852.540678:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137852.540692:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137852.540703:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137852.540728:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137852.540829:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137852.540884:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137852.541056:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520576 00000100:00100000:3.0:1783137852.541063:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520576 00000100:00100000:3.0:1783137852.541114:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783137852.541123:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322520576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137852.541138:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137852.541164:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b70c9 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.541188:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.541197:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.541206:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6200, rc 0) 00000100:00100000:3.0:1783137852.541251:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137852.541258:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783137852.542487:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137852.542509:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.542520:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137852.542608:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137852.542660:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137852.542688:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137852.542778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520704 00000100:00100000:1.0:1783137852.542783:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520704 00000100:00100000:1.0:1783137852.543107:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783137852.543117:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137852.543379:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137852.543387:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783137852.543458:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.543488:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.543526:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137852.548484:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137852.551392:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520832 00000100:00100000:0.0:1783137852.551406:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520832 00000100:00100000:0.0:1783137852.551456:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783137852.551466:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137852.551775:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (8245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.551785:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783137852.553020:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783137852.554263:0:11078:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783137852.554325:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783137852.554344:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137852.554356:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.554366:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137852.554376:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783137852.554378:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5ce5000 from 7 10000000:01000000:3.0:1783137852.554381:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137852.554415:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.554424:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.554435:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137852.554457:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.554513:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137852.554572:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137852.555094:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322520960 00000100:00100000:0.0:1783137852.555102:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322520960 00000100:00100000:0.0:1783137852.555132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783137852.555140:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322520960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137852.555155:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137852.555167:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b70d7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.555204:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.555215:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.555226:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030c00, rc 0) 00000100:00100000:0.0:1783137852.555279:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322520960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.555286:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783137852.555620:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322520960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137852.555637:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.555656:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137852.555710:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.555742:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137852.555779:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137852.555928:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521088 00000100:00100000:1.0:1783137852.555933:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521088 00000100:00100000:1.0:1783137852.555958:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783137852.555965:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322521088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137852.562338:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322521088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6363us (6585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137852.562353:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783137852.562470:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.562531:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.562634:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137852.562676:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137852.562733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521216 00000100:00100000:2.0:1783137852.562742:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521216 00000100:00100000:2.0:1783137852.562802:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783137852.562810:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322521216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137852.563001:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322521216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137852.563007:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783137852.563171:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783137852.564229:0:11079:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783137852.568702:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783137852.568739:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137852.568761:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137852.568773:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137852.568785:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137852.569013:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd09a3000 from 7 10000000:01000000:1.0:1783137852.569023:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137852.569065:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137852.569073:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137852.569082:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137852.569108:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137852.569177:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137852.570058:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412600 going to sleep for 11 seconds 00000100:00100000:2.0:1783137852.580344:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521344 00000100:00100000:2.0:1783137852.580359:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521344 00000100:00100000:2.0:1783137852.594443:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783137852.594460:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322521344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137852.594480:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137852.594498:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b70e5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137852.594526:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137852.594537:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137852.594575:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684a00, rc 0) 00000100:00100000:2.0:1783137852.595003:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322521344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 548us (25824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137852.595011:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783137852.595051:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137852.595071:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.595081:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137852.595154:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.595190:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137852.595227:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137852.595270:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521472 00000100:00100000:0.0:1783137852.595276:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521472 00000100:00100000:0.0:1783137852.595311:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783137852.595318:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322521472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137852.595630:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322521472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.595637:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783137852.595817:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137852.595968:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137852.596009:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137852.596038:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137852.596080:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521600 00000100:00100000:3.0:1783137852.596091:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521600 00000100:00100000:3.0:1783137852.596124:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783137852.596130:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322521600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.596283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322521600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137852.596289:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783137852.596967:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322521600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783137852.599341:0:11082:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783137852.599663:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783137852.599685:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137852.599696:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.599708:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137852.709335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137852.709445:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413760 00000100:00100000:3.0:1783137852.709461:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413760 00000100:00100000:3.0:1783137852.709581:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 244 00000100:00100000:3.0:1783137852.709595:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:5582:x1869755299413760:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137852.709622:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137852.709660:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922550 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.709715:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.709730:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137852.709742:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6600, rc 0) 00000100:00100000:3.0:1783137852.711768:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299413760:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 2165us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137852.711780:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 244 00000100:00100000:1.0:1783137852.720067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137852.720113:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299413888 00000100:00100000:0.0:1783137852.720123:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299413888 00000100:00100000:0.0:1783137852.720189:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 245 00000100:00100000:0.0:1783137852.720200:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299413888:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137852.720993:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299413888:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 792us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.721003:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 245 00000100:00100000:0.0:1783137852.732662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137852.732770:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414016 00000100:00100000:1.0:1783137852.732782:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414016 00000100:00100000:1.0:1783137852.732835:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 246 00000100:00100000:1.0:1783137852.732844:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299414016:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137852.733062:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299414016:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 217us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137852.733071:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 246 00000100:00100000:3.0:1783137852.759514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137852.759661:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414144 00000100:00100000:0.0:1783137852.759679:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414144 00000100:00100000:0.0:1783137852.759739:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:0.0:1783137852.759750:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299414144:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137852.759767:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137852.759785:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922557 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.759813:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.759825:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137852.759834:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031600, rc 0) 00000100:00100000:0.0:1783137852.759893:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299414144:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137852.759901:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 247 00000100:00100000:1.0:1783137852.782769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137852.792021:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414272 00000100:00100000:3.0:1783137852.792046:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414272 00000100:00100000:3.0:1783137852.792142:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:3.0:1783137852.792151:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299414272:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.792454:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299414272:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 303us (9694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137852.792463:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 248 00000100:00100000:3.0:1783137852.798232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137852.798270:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414400 00000100:00100000:3.0:1783137852.798281:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414400 00000100:00100000:3.0:1783137852.798336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 249 00000100:00100000:3.0:1783137852.798345:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299414400:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137852.798577:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299414400:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 231us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137852.798584:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 249 00010000:00010000:2.0:1783137852.923024:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137853.948666:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137854.142059:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322521728:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142212:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322522240:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142299:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137854.142305:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322522112:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142365:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322521856:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142390:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142408:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322522368:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142428:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142445:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137854.142451:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322521984:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.142495:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137854.142529:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521728 00000100:00100000:2.0:1783137854.142537:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521728 00000100:00100000:0.0:1783137854.145989:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522240 00000100:00100000:0.0:1783137854.146006:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522240 00000100:00100000:0.0:1783137854.146097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521856 00000100:00100000:0.0:1783137854.146101:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521856 00000100:00100000:0.0:1783137854.146114:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322521984 00000100:00100000:0.0:1783137854.146116:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322521984 00000100:00100000:0.0:1783137854.146147:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783137854.146157:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322522240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137854.146255:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322522240:12345-0@lo:400:kworker.0 Request processed in 99us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.146263:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783137854.146279:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783137854.146293:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137854.146332:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322521856:12345-0@lo:400:kworker.0 Request processed in 40us (3941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.146338:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783137854.146350:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783137854.146357:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322521984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137854.146384:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322521984:12345-0@lo:400:kworker.0 Request processed in 28us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.146390:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783137854.146411:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522112 00000100:00100000:0.0:1783137854.146414:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522112 00000100:00100000:0.0:1783137854.146440:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522368 00000100:00100000:0.0:1783137854.146442:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522368 00000100:00100000:0.0:1783137854.146459:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783137854.146465:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322522112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137854.146495:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322522112:12345-0@lo:400:kworker.0 Request processed in 29us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.146500:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783137854.146512:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783137854.146518:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322522368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137854.146575:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322522368:12345-0@lo:400:kworker.0 Request processed in 56us (4144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.146580:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783137854.146731:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137854.146745:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137854.146748:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783137854.149317:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c1880 x1869755322522112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137854.149337:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322522112:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.149353:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322522240:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.149410:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322521984:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.149423:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322521856:0@lo:400:kworker.0 00010000:00080000:2.0:1783137854.149435:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c0a80 x1869755322522368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137854.149444:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322522368:0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.149479:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783137854.149494:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322521728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137854.149610:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322521728:12345-0@lo:400:kworker.0 Request processed in 121us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137854.149617:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783137854.149659:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322521728:0@lo:400:kworker.0 00000100:00100000:1.0:1783137854.656479:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137854.656503:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322522496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137854.656596:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137854.656845:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522496 00000100:00100000:0.0:1783137854.656853:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522496 00000100:00100000:0.0:1783137854.656912:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783137854.656922:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322522496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137854.656967:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137854.657020:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322522496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137854.657027:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1783137854.657066:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfb0a4a80 x1869755322522496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137854.657085:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322522496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137854.976340:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137855.995743:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137856.073826:0:11247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783137856.610493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137856.610658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137856.610682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137856.610797:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414784 00000100:00100000:1.0:1783137856.610808:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414784 00000100:00100000:1.0:1783137856.610868:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414656 00000100:00100000:1.0:1783137856.610871:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414656 00000100:00100000:1.0:1783137856.610896:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:1.0:1783137856.610908:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299414784:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137856.611049:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:2.0:1783137856.611061:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299414656:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137856.612658:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414528 00000100:00100000:0.0:1783137856.612672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414528 00000100:00100000:0.0:1783137856.615634:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 251 00000100:00100000:0.0:1783137856.615658:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299414528:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137856.615803:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299414784:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 4896us (5142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137856.615812:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00080000:1.0:1783137856.615847:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137856.616857:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299414656:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 5792us (6166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137856.616882:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:0.0:1783137856.617760:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299414528:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 2052us (7220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137856.617773:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 251 00010000:00010000:1.0:1783137857.018841:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137857.219175:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322522624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137857.219323:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137857.219496:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522624 00000100:00100000:0.0:1783137857.219505:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522624 00000100:00100000:0.0:1783137857.219640:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137857.219651:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322522624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137857.219685:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783137857.227913:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137857.228665:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322522624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9008us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137857.228680:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1783137857.228901:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5e01433100 x1869755322522624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137857.228927:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322522624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137858.046028:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137859.066756:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137859.259003:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137859.266330:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322522752:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.266453:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137859.266878:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522752 00000100:00100000:3.0:1783137859.266890:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522752 00000100:00100000:3.0:1783137859.266994:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783137859.267017:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322522752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137859.267109:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322522752:12345-0@lo:400:kworker.0 Request processed in 94us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137859.267118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783137859.267214:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322522752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137859.267577:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137859.267601:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322523136:0@lo:400:kworker.0 00000100:00100000:2.0:1783137859.267664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137859.267719:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322523264:0@lo:400:kworker.0 00000100:00100000:2.0:1783137859.267748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137859.267783:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523264 00000100:00100000:2.0:1783137859.267788:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523264 00000100:00100000:2.0:1783137859.267839:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783137859.267847:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322523264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137859.267892:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322523264:12345-0@lo:400:kworker.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137859.267898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1783137859.267920:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137859.267951:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322523264:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.268700:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322522880:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.268750:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137859.268775:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322523392:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.268796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137859.268816:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137859.268822:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322523008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.268842:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137859.268880:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523136 00000100:00100000:0.0:1783137859.268885:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523136 00000100:00100000:0.0:1783137859.268926:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523392 00000100:00100000:0.0:1783137859.268929:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523392 00000100:00100000:0.0:1783137859.268949:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783137859.268956:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322523136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.268997:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322523136:12345-0@lo:400:kworker.0 Request processed in 41us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137859.269004:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783137859.269016:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783137859.269021:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322523392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.269044:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322523392:12345-0@lo:400:kworker.0 Request processed in 23us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137859.269049:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783137859.269065:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322522880 00000100:00100000:0.0:1783137859.269068:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322522880 00000100:00100000:0.0:1783137859.269088:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523008 00000100:00100000:0.0:1783137859.269101:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523008 00000100:00100000:0.0:1783137859.269120:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783137859.269125:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322522880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.269151:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322522880:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137859.269157:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783137859.269166:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783137859.269171:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322523008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.269189:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322523008:12345-0@lo:400:kworker.0 Request processed in 19us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137859.269194:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1783137859.269221:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137859.269225:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137859.269227:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137859.269252:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322523008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137859.269262:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322522880:0@lo:400:kworker.0 00010000:00080000:0.0:1783137859.269273:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5f8a680 x1869755322523392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137859.269284:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322523392:0@lo:400:kworker.0 00010000:00080000:0.0:1783137859.269314:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc23c3100 x1869755322523136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137859.269323:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322523136:0@lo:400:kworker.0 00000001:02000400:0.0:1783137859.646253:0:11347:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:04:17 (1783137857) === 00000100:00100000:3.0:1783137859.771001:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137859.771029:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322523520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137859.771107:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137859.771206:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523520 00000100:00100000:1.0:1783137859.771213:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523520 00000100:00100000:1.0:1783137859.771270:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783137859.771280:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322523520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137859.771323:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137859.771379:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322523520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137859.771385:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1783137859.771420:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfb0a4700 x1869755322523520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137859.771440:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322523520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137859.852234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137859.852311:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299414912 00000100:00100000:1.0:1783137859.852321:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299414912 00000100:00100000:1.0:1783137859.852398:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1783137859.852409:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299414912:12345-192.168.202.24@tcp:41:mkdir.0 00000004:00000024:1.0:1783137859.852473:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137859.852606:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299414912:12345-192.168.202.24@tcp:41:mkdir.0 Request processed in 198us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137859.852614:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00080000:3.0:1783137859.857912:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137859.858133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137859.858626:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415040 00000100:00100000:3.0:1783137859.858637:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415040 00000100:00100000:3.0:1783137859.858697:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783137859.858707:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75742c0b-74ec-412f-af86-0dbffc92280b+6:9670:x1869755299415040:12345-192.168.202.24@tcp:700:mkdir.0 00000100:00100000:3.0:1783137859.858791:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75742c0b-74ec-412f-af86-0dbffc92280b+6:9670:x1869755299415040:12345-192.168.202.24@tcp:700:mkdir.0 Request processed in 85us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137859.858810:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1783137859.861049:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137859.861133:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415296 00000100:00100000:0.0:1783137859.861151:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415296 00000100:00100000:0.0:1783137859.861235:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783137859.861246:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:9670:x1869755299415296:12345-192.168.202.24@tcp:36:mkdir.0 00010000:00010000:0.0:1783137859.861306:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137859.861376:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b6fe2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224d9 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.861396:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2a00) 00010000:00010000:0.0:1783137859.861407:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137859.861794:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.862200:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.862219:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.862254:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.862262:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.862268:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137859.868204:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783137859.868372:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868383:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868391:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868396:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137859.868401:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868407:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868426:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc9ecf00) 00010000:00010000:1.0:1783137859.868428:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137859.868433:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137859.868438:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030000/0x4691dfc3d66b7101 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137859.868471:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000e3c6e8 reply state 00000000dc556050 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137859.868481:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137859.869571:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:9670:x1869755299415296:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 8317us (8523us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783137859.869591:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00010000:00010000:3.0:1783137859.881171:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881199:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881210:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881218:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137859.881225:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881256:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881284:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e5dcc9ec900) 00010000:00010000:3.0:1783137859.881288:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137859.881294:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.881302:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b7108 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137859.883084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137859.883126:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415424 00000100:00100000:0.0:1783137859.883137:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415424 00000100:00100000:0.0:1783137859.883192:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783137859.883203:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:9671:x1869755299415424:12345-192.168.202.24@tcp:101:chmod.0 00010000:00010000:0.0:1783137859.883244:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137859.883271:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b710f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392255e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883348:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883364:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883379:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137859.883451:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783137859.883455:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137859.883496:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883528:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b710f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392255e expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883565:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392255e expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137859.883575:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc9ecb00) 00010000:00010000:0.0:1783137859.883578:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137859.883592:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137859.883659:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:9671:x1869755299415424:12345-192.168.202.24@tcp:101:chmod.0 Request processed in 458us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137859.883677:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783137859.898369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137859.898660:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415680 00000100:00100000:3.0:1783137859.898680:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415680 00000100:00100000:3.0:1783137859.898750:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:3.0:1783137859.898762:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:9671:x1869755299415680:12345-192.168.202.24@tcp:36:chmod.0 00010000:00010000:3.0:1783137859.898828:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137859.898856:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392255e expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.898885:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc9ecb00) 00010000:00010000:3.0:1783137859.898898:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137859.898926:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.898939:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.898948:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137859.899332:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012592a0e reply state 00000000a15ccca8 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137859.899343:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783137859.899359:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783137859.899458:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+8:9671:x1869755299415680:12345-192.168.202.24@tcp:36:chmod.0 Request processed in 698us (1101us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783137859.899465:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00010000:00010000:3.0:1783137859.902434:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902451:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902459:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902465:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137859.902470:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902477:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902495:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2e00) 00010000:00010000:3.0:1783137859.902498:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783137859.902503:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137859.902510:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b711d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137859.928107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137859.928667:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415808 00000100:00100000:2.0:1783137859.928679:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415808 00000100:00100000:2.0:1783137859.928737:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:2.0:1783137859.928747:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:9672:x1869755299415808:12345-192.168.202.24@tcp:101:chown.0 00010000:00010000:2.0:1783137859.928777:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137859.928809:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922565 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.928871:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.928885:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.928896:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137859.928957:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783137859.928960:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137859.928994:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.929018:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922565 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.929035:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922565 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.929043:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137859.929046:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137859.929050:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685200, rc 0) 00000100:00100000:2.0:1783137859.929116:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:9672:x1869755299415808:12345-192.168.202.24@tcp:101:chown.0 Request processed in 370us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137859.929123:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1783137859.932155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137859.934664:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299415936 00000100:00100000:2.0:1783137859.934676:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299415936 00000100:00100000:2.0:1783137859.934741:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:2.0:1783137859.934752:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:9672:x1869755299415936:12345-192.168.202.24@tcp:101:chown.0 00010000:00010000:2.0:1783137859.934775:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137859.934808:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392256c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934884:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934900:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934914:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934929:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934936:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.934942:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935054:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935064:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935092:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137859.935134:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783137859.935138:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137859.935159:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935170:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935176:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935182:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935187:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137859.935191:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935198:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935211:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137859.935226:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137859.935230:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935236:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935261:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935267:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935272:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935277:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137859.935281:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935286:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935294:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e5de2d1c000) 00010000:00010000:2.0:1783137859.935296:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137859.935298:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935303:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935335:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392256c expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935349:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392256c expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.935368:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137859.935371:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137859.935373:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685400, rc 0) 00000100:00100000:2.0:1783137859.935449:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:9672:x1869755299415936:12345-192.168.202.24@tcp:101:chown.0 Request processed in 699us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137859.935456:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1783137859.940762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137859.940831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299416192 00000100:00100000:2.0:1783137859.940847:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299416192 00000100:00100000:2.0:1783137859.940934:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:2.0:1783137859.940945:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:9672:x1869755299416192:12345-192.168.202.24@tcp:36:chown.0 00010000:00010000:2.0:1783137859.941003:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137859.941033:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392256c expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.941053:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137859.941062:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137859.941099:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.941111:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137859.941119:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137860.003505:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1783137860.003525:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1783137860.003786:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7e6ea3d reply state 00000000963c7e40 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137860.003811:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783137860.003987:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1783137860.004110:0:5813:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1783137860.004138:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:9672:x1869755299416192:12345-192.168.202.24@tcp:36:chown.0 Request processed in 63190us (63389us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783137860.004148:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00010000:00010000:1.0:1783137860.004442:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004452:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004460:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004466:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.004471:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004479:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004495:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:1.0:1783137860.004499:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783137860.004503:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.004522:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684000/0x4691dfc3d66b714e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137860.028260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.028419:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299416320 00000100:00100000:0.0:1783137860.028428:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299416320 00000100:00100000:0.0:1783137860.028482:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1783137860.028491:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:9673:x1869755299416320:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:0.0:1783137860.028516:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137860.030030:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922573 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137860.032938:0:7189:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2841us 00010000:00010000:0.0:1783137860.071384:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071410:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071424:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071442:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071449:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071468:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.071991:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072000:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072007:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137860.072087:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137860.072091:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137860.072184:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072196:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072202:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072208:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072226:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137860.072231:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072238:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072260:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137860.072263:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137860.072270:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072277:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b715c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072290:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072295:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072301:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072305:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137860.072307:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072314:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072320:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137860.072323:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137860.072325:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072331:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072385:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922573 expref: 8 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072401:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922573 expref: 7 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.072408:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137860.072410:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783137860.072412:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030400, rc 0) 00000100:00100000:0.0:1783137860.072493:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:9673:x1869755299416320:12345-192.168.202.24@tcp:101:touch.500 Request processed in 44002us (44241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137860.072503:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1783137860.083601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137860.083876:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299416576 00000100:00100000:3.0:1783137860.083888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299416576 00000100:00100000:3.0:1783137860.083955:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1783137860.083964:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:9673:x1869755299416576:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:3.0:1783137860.083987:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137860.084008:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7171 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392257a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084471:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084490:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084505:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084629:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084638:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.084658:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137860.088515:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783137860.089418:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089437:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089449:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089490:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089497:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089504:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089511:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.089516:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089523:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.089536:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:1.0:1783137860.089539:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.091100:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.091131:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7178 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137860.091170:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009851e5c5 reply state 0000000074163863 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137860.091181:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783137860.091306:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7171 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392257a expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.091325:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392257a expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.091334:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:1.0:1783137860.091337:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137860.091340:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6cc00, rc 0) 00000100:00100000:1.0:1783137860.091420:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+10:9673:x1869755299416576:12345-192.168.202.24@tcp:101:touch.500 Request processed in 7455us (7841us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783137860.091429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00010000:00010000:0.0:1783137860.093142:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137860.093989:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094005:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094011:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094016:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.094034:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094042:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094059:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff8e5dc39a2d00) 00010000:00010000:1.0:1783137860.094062:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.094066:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.094073:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b717f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137860.098658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137860.099709:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299416832 00000100:00100000:2.0:1783137860.099725:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299416832 00000100:00100000:2.0:1783137860.099822:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:2.0:1783137860.099833:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:9673:x1869755299416832:12345-192.168.202.24@tcp:36:touch.500 00010000:00010000:2.0:1783137860.099900:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137860.099934:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392257a expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.099957:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:2.0:1783137860.099968:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137860.100025:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.100039:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.100049:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137860.100212:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000486d4cac reply state 00000000eae38ce2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137860.100221:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137860.100325:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+10:9673:x1869755299416832:12345-192.168.202.24@tcp:36:touch.500 Request processed in 493us (1678us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783137860.100333:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:3.0:1783137860.107083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.107766:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299416960 00000100:00100000:0.0:1783137860.107778:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299416960 00000100:00100000:0.0:1783137860.107836:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1783137860.107846:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+10:9673:x1869755299416960:12345-192.168.202.24@tcp:101:touch.500 00010000:00010000:0.0:1783137860.107871:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137860.107892:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b719b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922581 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.107965:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b719b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922581 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.108004:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b719b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922581 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.108029:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5de2d1cb00) 00010000:00010000:0.0:1783137860.108032:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137860.108036:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:0.0:1783137860.108114:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+11:9673:x1869755299416960:12345-192.168.202.24@tcp:101:touch.500 Request processed in 269us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137860.108121:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00010000:00010000:2.0:1783137860.108597:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108607:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108614:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108628:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137860.108633:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108641:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108657:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5de2d1cb00) 00010000:00010000:2.0:1783137860.108659:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137860.108663:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.108669:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137860.115779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.116662:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417088 00000100:00100000:0.0:1783137860.116688:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417088 00000100:00100000:0.0:1783137860.116768:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783137860.116778:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299417088:12345-192.168.202.24@tcp:8:touch.500 00010000:00080000:0.0:1783137860.116817:0:6616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:0.0:1783137860.117067:0:6616:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b71a2 00002000:00100000:0.0:1783137860.117082:0:6616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75742c0b-74ec-412f-af86-0dbffc92280b/ffff8e5df5965000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783137860.117095:0:6616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783137860.117370:0:6616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783137860.117405:0:6616:0:(import.c:65:import_set_state_nolock()) ffff8e5df5964000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137860.117601:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299417088:12345-192.168.202.24@tcp:8:touch.500 Request processed in 710us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137860.117610:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1783137860.124477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.124610:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417216 00000100:00100000:0.0:1783137860.124627:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417216 00000100:00100000:0.0:1783137860.124753:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1783137860.124765:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:0:x1869755299417216:12345-192.168.202.24@tcp:2:touch.500 00000100:00080000:3.0:1783137860.124820:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1783137860.186393:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1783137860.186414:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000100:00100000:2.0:1783137860.188087:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:0:x1869755299417216:12345-192.168.202.24@tcp:2:touch.500 Request processed in 63311us (63614us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783137860.188100:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:3.0:1783137860.192087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137860.192212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417472 00000100:00100000:1.0:1783137860.192232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417472 00000100:00100000:1.0:1783137860.192328:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1783137860.192341:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+10:9673:x1869755299417472:12345-192.168.202.24@tcp:35:touch.500 00000100:00100000:1.0:1783137860.192823:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+11:9673:x1869755299417472:12345-192.168.202.24@tcp:35:touch.500 Request processed in 484us (756us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783137860.192831:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:3.0:1783137860.218221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137860.218305:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417600 00000100:00100000:2.0:1783137860.218322:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417600 00000100:00100000:2.0:1783137860.218401:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1783137860.218413:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+11:9674:x1869755299417600:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1783137860.218437:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137860.218456:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b71a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922588 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.218600:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.218616:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.218627:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137860.218687:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783137860.218691:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137860.218741:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.218766:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b71a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922588 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.219028:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922588 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.219038:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:2.0:1783137860.219041:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137860.219044:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684600, rc 0) 00000100:00100000:2.0:1783137860.219100:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+12:9674:x1869755299417600:12345-192.168.202.24@tcp:101:rm.0 Request processed in 690us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137860.219107:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1783137860.231614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.231722:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417856 00000100:00100000:0.0:1783137860.231750:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417856 00000100:00100000:0.0:1783137860.231850:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:0.0:1783137860.231860:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+12:9674:x1869755299417856:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1783137860.231881:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137860.231903:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b71b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392258f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137860.232030:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783137860.232231:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b71b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392258f expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.232247:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137860.232250:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137860.232256:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b71b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392258f expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.232273:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137860.232362:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+13:9674:x1869755299417856:12345-192.168.202.24@tcp:101:rm.0 Request processed in 503us (821us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1783137860.232371:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:2.0:1783137860.240262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137860.242995:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299417984 00000100:00100000:1.0:1783137860.243013:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299417984 00000100:00100000:1.0:1783137860.243097:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1783137860.243109:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+13:9674:x1869755299417984:12345-192.168.202.24@tcp:37:rm.0 00000100:00100000:0.0:1783137860.253343:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+13:9674:x1869755299417984:12345-192.168.202.24@tcp:37:rm.0 Request processed in 10219us (13082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137860.253363:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1783137860.261777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137860.262090:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299418240 00000100:00100000:2.0:1783137860.262125:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299418240 00000100:00100000:2.0:1783137860.262252:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1783137860.262264:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc60e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+13:9674:x1869755299418240:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:2.0:1783137860.262628:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc60e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+14:9674:x1869755299418240:12345-192.168.202.24@tcp:35:rm.0 Request processed in 365us (867us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783137860.262636:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1783137860.268888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.269261:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299418496 00000100:00100000:0.0:1783137860.269288:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299418496 00000100:00100000:0.0:1783137860.271568:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1783137860.271608:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:9674:x1869755299418496:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1783137860.271636:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137860.271658:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b71c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922596 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.272094:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b71cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.272111:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b71cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.272124:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b71cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137860.272135:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783137860.272270:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b71c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922596 expref: 17 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.272293:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b71cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922596 expref: 16 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137860.272302:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137860.272305:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137860.272309:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030200, rc 0) 00000100:00100000:0.0:1783137860.272394:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299418496:12345-192.168.202.24@tcp:101:rm.0 Request processed in 802us (3738us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783137860.272403:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:3.0:1783137860.276243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.276309:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299418624 00000100:00100000:0.0:1783137860.276324:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299418624 00000100:00100000:0.0:1783137860.276444:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:0.0:1783137860.276456:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299418624:12345-192.168.202.24@tcp:41:rm.0 00000004:00000024:0.0:1783137860.276541:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1783137860.276684:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299418624:12345-192.168.202.24@tcp:41:rm.0 Request processed in 219us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137860.276691:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:0.0:1783137860.283080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137860.283176:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299418752 00000100:00100000:1.0:1783137860.283192:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299418752 00000100:00100000:1.0:1783137860.283277:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1783137860.283288:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299418752:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:1.0:1783137860.283326:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137860.283349:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b71da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392259d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283415:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283429:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283441:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283455:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283463:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283469:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283681:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283690:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283697:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137860.283727:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783137860.283746:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137860.283771:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283793:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283874:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283882:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283890:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283897:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.283902:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283910:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283923:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:1.0:1783137860.283926:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.283931:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283937:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b71e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283950:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283967:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283973:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283978:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.283982:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283988:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.283997:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff8e5dc5113900) 00010000:00010000:1.0:1783137860.283999:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.284002:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.284008:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b71e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.284043:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b71da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392259d expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.284056:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392259d expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.284064:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5de2d1cb00) 00010000:00010000:1.0:1783137860.284066:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137860.284074:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6de00, rc 0) 00000100:00100000:1.0:1783137860.284152:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+17:9674:x1869755299418752:12345-192.168.202.24@tcp:101:rm.0 Request processed in 865us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137860.284160:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:2.0:1783137860.293090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137860.293178:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419008 00000100:00100000:1.0:1783137860.293190:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419008 00000100:00100000:1.0:1783137860.293260:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:1.0:1783137860.293272:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+17:9674:x1869755299419008:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1783137860.293336:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783137860.293368:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b71ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392259d expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293395:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b719b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922581 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293409:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5de2d1cb00) 00010000:00010000:1.0:1783137860.293430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b71b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922588 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293441:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:1.0:1783137860.293446:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137860.293475:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293490:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293499:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.293535:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.294336:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.294354:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.295013:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.295025:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.295033:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137860.297153:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1783137860.297172:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350189625863ns, next at 351189622547ns, rc = 0 00010000:00010000:1.0:1783137860.297260:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297276:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297286:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297294:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297315:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297321:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297357:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137860.297382:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297388:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297393:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297399:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.297403:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297410:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297422:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5dc5113200) 00010000:00010000:1.0:1783137860.297425:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783137860.297430:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297436:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7204 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297454:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297466:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297471:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297476:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.297478:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297483:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297503:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:1.0:1783137860.297507:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.297510:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.297516:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b71f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137860.297527:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022e64f86 reply state 0000000048d60611 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137860.297536:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783137860.298225:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137860.298234:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.298241:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ca00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783137860.298245:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.298252:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.298265:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e5dc5113200) 00010000:00010000:3.0:1783137860.298267:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783137860.298271:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.298277:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b720b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137860.298309:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137860.298311:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137860.298313:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137860.298436:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299419008:12345-192.168.202.24@tcp:36:rm.0 Request processed in 5161us (5353us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783137860.298446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:3.0:1783137860.304408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137860.304630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419264 00000100:00100000:0.0:1783137860.304649:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419264 00000100:00100000:0.0:1783137860.304732:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1783137860.304745:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299419264:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:0.0:1783137860.305446:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+17:9674:x1869755299419264:12345-192.168.202.24@tcp:35:rm.0 Request processed in 698us (1045us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783137860.305456:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00010000:00010000:1.0:1783137860.309762:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310058:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310067:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310074:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.310080:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310089:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310109:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff8e5dc5113300) 00010000:00010000:1.0:1783137860.310112:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.310118:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.310125:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b71fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137860.329075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137860.329223:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419520 00000100:00100000:2.0:1783137860.329234:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419520 00000100:00100000:1.0:1783137860.329886:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1783137860.329898:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+16:9674:x1869755299419520:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1783137860.329960:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783137860.329986:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b71cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922596 expref: 16 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330008:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030400/0x4691dfc3d66b716a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922573 expref: 15 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330034:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dcc9ec100) 00010000:00010000:1.0:1783137860.330051:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b712b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922565 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330060:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137860.330066:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137860.330091:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330102:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330112:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330127:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330134:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330141:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330449:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330457:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.330474:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137860.331455:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783137860.331475:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331484:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331694:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331702:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.331708:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331715:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331731:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e5dc5113500) 00010000:00010000:1.0:1783137860.331734:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783137860.331739:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331745:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7220 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331775:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331781:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331794:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331799:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137860.331803:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331809:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331817:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113300) 00010000:00010000:1.0:1783137860.331819:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137860.331822:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137860.331827:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7212 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137860.331838:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af477e28 reply state 00000000291f08c8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137860.331847:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137860.333503:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+15:9674:x1869755299419520:12345-192.168.202.24@tcp:36:rm.0 Request processed in 3590us (4422us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783137860.333521:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00010000:00010000:2.0:1783137860.335860:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335882:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335891:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335898:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137860.335903:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335911:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335931:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e5dc5113900) 00010000:00010000:2.0:1783137860.335934:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137860.335940:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137860.335966:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7219 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137861.119837:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137861.747102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137861.749891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137861.756610:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137861.756650:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419648 00000100:00100000:0.0:1783137861.756662:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419648 00000100:00100000:0.0:1783137861.756734:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 253 00000100:00100000:0.0:1783137861.756745:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299419648:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137861.756835:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299419648:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137861.756843:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 253 00000100:00100000:0.0:1783137861.756901:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137861.756926:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419904 00000100:00100000:0.0:1783137861.756930:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419904 00000100:00100000:0.0:1783137861.756959:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1783137861.756966:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299419904:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137861.757008:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299419904:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137861.757014:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:3.0:1783137861.761162:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299419776 00000100:00100000:3.0:1783137861.761175:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299419776 00000100:00100000:3.0:1783137861.761264:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420032 00000100:00100000:3.0:1783137861.761269:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420032 00000100:00100000:3.0:1783137861.761303:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:3.0:1783137861.761313:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:2352:x1869755299419776:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137861.761407:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:2352:x1869755299419776:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 95us (14316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137861.761414:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:3.0:1783137861.761432:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:3.0:1783137861.761438:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299420032:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137861.761461:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299420032:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (11585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137861.761467:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00080000:1.0:1783137861.762368:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137862.143503:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137862.333290:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322523648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137862.333370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137862.334085:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523648 00000100:00100000:1.0:1783137862.334107:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523648 00000100:00080000:3.0:1783137862.334298:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137862.334358:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783137862.334371:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322523648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137862.334410:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137862.334484:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322523648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137862.334509:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1783137862.334678:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d6300 x1869755322523648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137862.334700:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322523648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137863.163702:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137864.188344:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137864.379127:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322524160:0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.379259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137864.379280:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322523776:0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.379377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137864.379420:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322523904:0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.379435:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322524288:0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.379488:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137864.379496:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322524032:0@lo:400:kworker.0 00000100:00100000:3.0:1783137864.379689:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523776 00000100:00100000:3.0:1783137864.379698:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523776 00000100:00100000:3.0:1783137864.379747:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783137864.379756:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322523776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137864.379820:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322523776:12345-0@lo:400:kworker.0 Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137864.379850:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783137864.388734:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524160 00000100:00100000:0.0:1783137864.388750:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524160 00000100:00100000:0.0:1783137864.388866:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137864.388877:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.388983:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322524160:12345-0@lo:400:kworker.0 Request processed in 108us (9727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137864.388990:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1783137864.389047:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d4000 x1869755322524160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137864.389063:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322524160:0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.389316:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137864.390851:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322523904 00000100:00100000:0.0:1783137864.390864:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322523904 00000100:00100000:0.0:1783137864.390935:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783137864.390945:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137864.392137:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524288 00000100:00100000:2.0:1783137864.392153:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524288 00000100:00100000:2.0:1783137864.392217:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783137864.392232:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.397134:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322523776:0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.397229:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137864.397281:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322524416:0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.397381:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137864.397454:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524416 00000100:00100000:1.0:1783137864.397463:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524416 00000100:00100000:1.0:1783137864.397584:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783137864.397598:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137864.397665:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322524416:12345-0@lo:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137864.397673:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1783137864.397734:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d6a00 x1869755322524416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137864.397748:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322524416:0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.398047:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322523904:12345-0@lo:400:kworker.0 Request processed in 7092us (18561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137864.398062:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783137864.398103:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322523904:0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.398462:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524032 00000100:00100000:0.0:1783137864.398473:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524032 00000100:00100000:0.0:1783137864.398518:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783137864.398527:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137864.400288:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322524032:12345-0@lo:400:kworker.0 Request processed in 1748us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137864.400316:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1783137864.401361:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137864.401368:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137864.401371:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137864.405236:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322524032:0@lo:400:kworker.0 00000100:00100000:2.0:1783137864.405891:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322524288:12345-0@lo:400:kworker.0 Request processed in 13654us (16572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137864.405909:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783137864.411184:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322524288:0@lo:400:kworker.0 00000004:00080000:1.0:1783137864.890999:0:7800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354783451322ns, next at 355783448882ns, rc = 0 00000100:00100000:3.0:1783137864.891076:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137864.891098:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322524544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137864.891192:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137864.891879:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524544 00000100:00100000:1.0:1783137864.891888:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524544 00000100:00100000:1.0:1783137864.891946:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137864.891956:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322524544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137864.892000:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137864.892062:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322524544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137864.892070:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783137864.892430:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df594e680 x1869755322524544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137864.892450:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322524544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137865.210779:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137865.502508:0:11499:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1783137865.505080:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1783137865.505112:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783137865.505123:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1783137865.505128:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1783137865.505496:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322524672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783137865.505598:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137865.506207:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322524672 00000100:00100000:0.0:1783137865.506217:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322524672 00000100:00100000:0.0:1783137865.506273:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137865.506298:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322524672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783137865.506334:0:6615:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1783137865.506991:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a488643, atime: 0x6a488643, ctime: 0x6a488643, blocks: 0x1 00010000:00010000:0.0:1783137865.507004:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137865.507028:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1783137865.507049:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137865.507058:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137865.507078:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137865.507090:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137865.507099:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137865.508880:0:6615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783137865.510024:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322524672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3723us (4421us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783137865.510038:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1783137865.510107:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5df5e59880/2, rc 0, transno 4294967300 00000100:00100000:1.0:1783137865.510114:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322524672:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783137865.511268:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137865.511283:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137865.511297:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137865.511303:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137865.511315:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137865.511355:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137865.511372:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cccc562/0x4691dfc3d66b7227 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137865.511400:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137865.511402:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137865.511404:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137866.234847:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137866.854506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.854575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.854605:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.854646:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.854683:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420160 00000100:00100000:0.0:1783137866.854695:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420160 00000100:00100000:0.0:1783137866.854857:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 255 00000100:00100000:0.0:1783137866.854868:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299420160:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137866.854950:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299420160:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 84us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.854959:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 255 00000100:00100000:0.0:1783137866.854993:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420416 00000100:00100000:0.0:1783137866.854997:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420416 00000100:00100000:0.0:1783137866.855035:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1783137866.855042:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299420416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137866.855072:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299420416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.855078:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1783137866.855097:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420288 00000100:00100000:0.0:1783137866.855100:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420288 00000100:00100000:0.0:1783137866.855127:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420544 00000100:00100000:0.0:1783137866.855129:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420544 00000100:00100000:0.0:1783137866.855153:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1783137866.855159:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299420288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137866.855188:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299420288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.855194:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1783137866.855206:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:0.0:1783137866.855212:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299420544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137866.855236:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299420544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.855251:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00080000:0.0:1783137866.855679:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137866.855684:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1783137866.949771:0:11547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1e8686b0 20000000:00000080:3.0:1783137866.949792:0:11547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5dc7e2ec00 uarg=0000000000000000 20000000:01000000:3.0:1783137866.949841:0:11547:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783137866.949853:0:11547:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783137866.949860:0:11547:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783137866.953874:0:11548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783137866.956795:0:11547:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783137866.965422:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783137866.965485:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783137866.966744:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783137866.966773:0:11547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783137866.966794:0:11547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966814:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966822:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966828:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966838:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966864:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966872:0:11547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966918:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.966933:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 12 pid: 5806 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.966948:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322524800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137866.967060:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967068:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 12 pid: 5805 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.967077:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322524928:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137866.967109:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967117:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 18 pid: 5807 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.967126:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525056:0@lo:104: 00000100:00100000:2.0:1783137866.967169:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137866.967215:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967223:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 18 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.967231:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525184:0@lo:104: 00000100:00100000:2.0:1783137866.967254:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137866.967293:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525056 00000100:00100000:2.0:1783137866.967301:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525056 00000100:00100000:2.0:1783137866.967338:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525184 00000100:00100000:2.0:1783137866.967341:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525184 00000100:00100000:2.0:1783137866.967357:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137866.967366:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:11547:x1869755322525056:12345-0@lo:104: 00010000:00010000:2.0:1783137866.967379:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967425:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137866.967431:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+4:11547:x1869755322525056:12345-0@lo:104: Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137866.967438:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137866.967456:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137866.967463:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11547:x1869755322525184:12345-0@lo:104: 00010000:00010000:2.0:1783137866.967470:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967502:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783137866.967507:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11547:x1869755322525184:12345-0@lo:104: Request processed in 45us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137866.967535:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1783137866.967588:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137866.967594:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967601:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137866.967605:0:7510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.967615:0:7510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137866.968654:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137866.968666:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 18 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137866.968677:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525312:0@lo:104: 00000100:00100000:3.0:1783137866.968716:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137866.968751:0:11547:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137866.968774:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525056:0@lo:104: 00000100:00100000:3.0:1783137866.968782:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525184:0@lo:104: 00000100:00100000:0.0:1783137866.969018:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783137866.969031:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525312 00000100:00100000:0.0:1783137866.969035:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525312 00000100:00100000:0.0:1783137866.969087:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137866.969096:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11547:x1869755322525312:12345-0@lo:104: 00010000:00010000:0.0:1783137866.969108:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969163:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783137866.969169:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83444777-5c31-482f-a1f5-fb6cbc8d0848+3:11547:x1869755322525312:12345-0@lo:104: Request processed in 75us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.969175:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783137866.969220:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137866.969227:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969234:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137866.969238:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969246:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137866.969253:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137866.969267:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783137866.969303:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969310:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137866.969332:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969340:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6400/0x4691dfc3d66b70d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969352:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137866.969356:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969361:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6da00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137866.969363:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969369:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137866.969375:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137866.969379:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783137866.969390:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969395:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137866.969417:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969424:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6da00/0x4691dfc3d66b70c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.969433:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137866.969434:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137866.969436:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137866.969448:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322525440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137866.969478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137866.969506:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322525568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137866.969541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137866.969662:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322525312:0@lo:104: 10000000:00010000:2.0:1783137866.970593:0:7510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137866.970602:0:7510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137866.970753:0:7510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.970760:0:7510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137866.970785:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.970792:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6ce00/0x4691dfc3d66b70e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b70ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.970811:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137866.970813:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137866.970815:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137866.970824:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137866.970926:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137866.970938:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322525696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137866.970991:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137866.971069:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525440 00000100:00100000:2.0:1783137866.971075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525440 00010000:00010000:2.0:1783137866.971102:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 19 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.971135:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525568 00000100:00100000:2.0:1783137866.971138:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525568 00010000:00010000:2.0:1783137866.971150:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 20 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.971160:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525696 00000100:00100000:2.0:1783137866.971162:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525696 00010000:00010000:2.0:1783137866.971174:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 21 pid: 5807 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.971187:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137866.971195:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+21:3315:x1869755322525440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137866.971206:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137866.971211:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 21 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971221:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 21 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971234:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030c00/0x4691dfc3d66b70de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b70d7 expref: 21 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971247:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137866.971286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3315:x1869755322525440:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137866.971293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137866.971314:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137866.971320:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322525568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137866.971327:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137866.971332:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 19 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971339:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 19 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971349:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a6200/0x4691dfc3d66b70d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b70c9 expref: 19 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971359:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137866.971387:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:3316:x1869755322525568:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137866.971393:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137866.971404:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137866.971410:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3316:x1869755322525696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137866.971434:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137866.971439:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 17 pid: 5807 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971447:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 17 pid: 5807 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971456:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b70ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b70e5 expref: 17 pid: 5807 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.971467:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137866.971496:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3316:x1869755322525696:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137866.971502:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783137866.971701:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322525440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137866.972069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.972095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137866.972110:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420800 00000100:00100000:0.0:1783137866.972115:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420800 00010000:00010000:0.0:1783137866.972135:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 13 pid: 5805 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137866.972150:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420672 00000100:00100000:0.0:1783137866.972152:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420672 00010000:00010000:0.0:1783137866.972162:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 14 pid: 5806 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137866.972174:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:0.0:1783137866.972181:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+14:2352:x1869755299420800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137866.972200:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137866.972205:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 14 pid: 5805 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972214:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 14 pid: 5805 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972225:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137866.972265:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+14:2352:x1869755299420800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.972271:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:0.0:1783137866.972285:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:0.0:1783137866.972291:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299420672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137866.972298:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137866.972302:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 13 pid: 5806 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972311:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 13 pid: 5806 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972321:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972329:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972342:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972359:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972366:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972373:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972379:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137866.972383:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972390:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972398:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137866.972408:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137866.972429:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299420672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137866.972435:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1783137866.972820:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322525696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137866.972830:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322525568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137866.977047:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031600/0x4691dfc3d66b70fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922557 expref: 12 pid: 5806 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.977074:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4207480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322524800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137866.977087:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a6600/0x4691dfc3d66b70f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922550 expref: 11 pid: 5805 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137866.977098:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1869755322524928:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137866.977136:0:11547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.977147:0:11547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.977154:0:11547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137866.977160:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5685400/0x4691dfc3d66b722e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137867.258792:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137867.454871:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322525824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137867.454946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137867.459832:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525824 00000100:00100000:2.0:1783137867.459847:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525824 00000100:00100000:2.0:1783137867.459981:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783137867.459993:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322525824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137867.460052:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137867.460156:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322525824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137867.460164:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1783137867.462861:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d5880 x1869755322525824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137867.462895:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322525824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783137867.472023:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1783137868.026679:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137868.026701:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5c0e000 from 7 10000000:01000000:1.0:1783137868.026706:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137868.027255:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.027269:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.027280:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137868.027310:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322525952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.028273:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137868.028415:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.036524:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322525952 00000100:00100000:0.0:1783137868.036563:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322525952 00000100:00100000:0.0:1783137868.036654:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783137868.036675:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:5809:x1869755322525952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137868.036729:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137868.036765:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030400/0x4691dfc3d66b723c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b7235 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.037064:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030400/0x4691dfc3d66b723c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b7235 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.037080:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030400/0x4691dfc3d66b723c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b7235 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.037091:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030400, rc 0) 00000100:00100000:0.0:1783137868.037201:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322525952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 538us (8930us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.037209:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783137868.037354:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322525952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137868.037375:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.037386:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137868.037461:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.037500:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137868.037593:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.038002:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526080 00000100:00100000:0.0:1783137868.038008:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526080 00000100:00100000:0.0:1783137868.038054:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783137868.038063:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322526080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.039041:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322526080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 975us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.039052:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783137868.039625:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.039696:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.040053:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137868.040106:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.040287:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526208 00000100:00100000:0.0:1783137868.040294:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526208 00000100:00100000:0.0:1783137868.040350:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783137868.040359:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322526208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.040580:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322526208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.040597:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783137868.044251:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.045415:0:11560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11560:1869755322526336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137868.045496:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137868.045572:0:11560:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.047079:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526336 00000100:00100000:0.0:1783137868.047094:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526336 00000100:00100000:0.0:1783137868.047176:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783137868.047187:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:11560:x1869755322526336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.047461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:11560:x1869755322526336:12345-0@lo:502:llog_process_th.0 Request processed in 275us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.047470:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783137868.048820:0:11560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11560:1869755322526336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137868.048873:0:11560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137868.048888:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137868.048891:0:11560:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783137868.048902:0:11560:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5dc5c0e000 00000020:00000080:1.0:1783137868.048916:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137868.049023:0:11560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11560:1869755322526464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137868.049084:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137868.050464:0:11560:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.050896:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526464 00000100:00100000:0.0:1783137868.050905:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526464 00000100:00100000:0.0:1783137868.054217:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783137868.054242:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:11560:x1869755322526464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.054564:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:11560:x1869755322526464:12345-0@lo:502:llog_process_th.0 Request processed in 331us (5479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.054573:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783137868.054730:0:11560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11560:1869755322526464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137868.054775:0:11560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137868.054784:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137868.054786:0:11560:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783137868.054794:0:11560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783137868.054971:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783137868.054993:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137868.055005:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.055018:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137868.055029:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137868.055031:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dc5ce5000 from 7 10000000:01000000:1.0:1783137868.055034:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137868.055068:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.055094:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.055105:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137868.055127:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.055175:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137868.072953:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73600 going to sleep for 11 seconds 00000100:00100000:2.0:1783137868.074573:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526592 00000100:00100000:2.0:1783137868.074586:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526592 00000100:00100000:2.0:1783137868.074641:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783137868.074650:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:5809:x1869755322526592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137868.074676:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137868.074694:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b724a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b7243 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.075982:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b724a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b7243 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.076001:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b724a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b7243 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.076030:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684a00, rc 0) 00000100:00100000:2.0:1783137868.076136:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322526592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1485us (20959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.076144:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783137868.076217:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137868.076235:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.076246:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137868.076326:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.076360:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137868.076391:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137868.076407:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526720 00000100:00100000:2.0:1783137868.076411:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526720 00000100:00100000:2.0:1783137868.076437:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783137868.076444:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322526720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.078363:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322526720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1910us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.078375:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783137868.078443:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.078490:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.078566:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137868.078604:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137868.078618:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526848 00000100:00100000:2.0:1783137868.078624:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526848 00000100:00100000:2.0:1783137868.078654:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783137868.081948:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322526848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.082900:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322526848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3862us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.082913:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783137868.083002:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322526848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.083999:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11563:1869755322526976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137868.084066:0:11563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137868.084510:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137868.084890:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322526976 00000100:00100000:2.0:1783137868.084898:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322526976 00000100:00100000:2.0:1783137868.084936:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783137868.084946:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:11563:x1869755322526976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137868.087227:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:11563:x1869755322526976:12345-0@lo:502:llog_process_th.0 Request processed in 2272us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.087243:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000040:00080000:2.0:1783137868.088754:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783137868.100935:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11563:1869755322526976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137868.101028:0:11563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137868.101039:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137868.101042:0:11563:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783137868.101052:0:11563:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5dc5ce5000 00000020:00000080:0.0:1783137868.101056:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783137868.101153:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11563:1869755322527104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.101232:0:11563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137868.101271:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df59b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137868.101370:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527104 00000100:00100000:3.0:1783137868.101378:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527104 00000100:00100000:3.0:1783137868.101425:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783137868.101434:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:11563:x1869755322527104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137868.101913:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:11563:x1869755322527104:12345-0@lo:502:llog_process_th.0 Request processed in 478us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137868.101921:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783137868.102848:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11563:1869755322527104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137868.102903:0:11563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137868.102911:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137868.102914:0:11563:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783137868.102921:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783137868.105144:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783137868.105186:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137868.105198:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137868.105210:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137868.105222:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783137868.105225:0:5809:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd09a3000 from 7 10000000:01000000:3.0:1783137868.105228:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137868.105268:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137868.105276:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137868.105286:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137868.105312:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137868.105393:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137868.105439:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9e71d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137868.105527:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527232 00000100:00100000:1.0:1783137868.105535:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527232 00000100:00100000:1.0:1783137868.105603:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783137868.105613:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:5809:x1869755322527232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137868.105629:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137868.105645:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6da00/0x4691dfc3d66b7258 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b7251 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.105680:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6da00/0x4691dfc3d66b7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b7251 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.105692:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6da00/0x4691dfc3d66b7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b7251 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137868.105700:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6da00, rc 0) 00000100:00100000:1.0:1783137868.105932:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322527232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.105939:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783137868.106611:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137868.106629:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137868.106639:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137868.106720:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137868.106929:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137868.106969:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9e71d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.108896:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527360 00000100:00100000:0.0:1783137868.108910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527360 00000100:00100000:0.0:1783137868.108969:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783137868.108979:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322527360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.109288:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322527360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.109294:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783137868.109351:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.109404:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.109454:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137868.109473:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df59b8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.109488:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527488 00000100:00100000:0.0:1783137868.109492:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527488 00000100:00100000:0.0:1783137868.109527:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783137868.109535:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322527488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.109691:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:5809:x1869755322527488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.109698:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783137868.109812:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83444777-5c31-482f-a1f5-fb6cbc8d0848:5809:1869755322527488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137868.110002:0:11566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11566:1869755322527616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.110037:0:11566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137868.110062:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527616 00000100:00100000:0.0:1783137868.110066:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527616 00000100:00100000:0.0:1783137868.110086:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783137868.110092:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:11566:x1869755322527616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.110229:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:11566:x1869755322527616:12345-0@lo:502:llog_process_th.0 Request processed in 135us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.110235:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783137868.110264:0:11566:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df59b8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.110278:0:11566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11566:1869755322527616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137868.110301:0:11566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137868.110312:0:11566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137868.110314:0:11566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783137868.110324:0:11566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5dd09a3000 00000020:00000080:0.0:1783137868.110326:0:11566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783137868.110391:0:11566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11566:1869755322527744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.110425:0:11566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137868.110443:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527744 00000100:00100000:0.0:1783137868.110446:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527744 00000100:00100000:0.0:1783137868.110467:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783137868.110473:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:11566:x1869755322527744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137868.110617:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:11566:x1869755322527744:12345-0@lo:502:llog_process_th.0 Request processed in 143us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.110623:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783137868.110650:0:11566:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137868.110661:0:11566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83444777-5c31-482f-a1f5-fb6cbc8d0848:11566:1869755322527744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137868.110677:0:11566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137868.110686:0:11566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137868.110687:0:11566:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783137868.110691:0:11566:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783137868.113878:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783137868.113919:0:5809:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137868.113932:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.113945:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.282797:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137868.448907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137868.449030:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299420928 00000100:00100000:0.0:1783137868.449046:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299420928 00000100:00100000:0.0:1783137868.449133:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 271 00000100:00100000:0.0:1783137868.449143:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+11:5582:x1869755299420928:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137868.449161:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137868.449179:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b725f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.449210:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b725f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225a4 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.449220:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b725f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225a4 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137868.449229:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030000, rc 0) 00000100:00100000:0.0:1783137868.449311:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299420928:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 169us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.449318:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 271 00000100:00100000:0.0:1783137868.451944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137868.452059:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421056 00000100:00100000:1.0:1783137868.452069:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421056 00000100:00100000:1.0:1783137868.452127:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 272 00000100:00100000:1.0:1783137868.452137:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299421056:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.452462:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299421056:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 325us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.452470:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 272 00000100:00100000:1.0:1783137868.471972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137868.472109:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421184 00000100:00100000:2.0:1783137868.472121:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421184 00000100:00100000:2.0:1783137868.472190:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 273 00000100:00100000:2.0:1783137868.472205:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299421184:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137868.472458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299421184:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 256us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.472476:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 273 00000100:00100000:3.0:1783137868.483814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137868.490266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421312 00000100:00100000:0.0:1783137868.490288:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421312 00000100:00100000:0.0:1783137868.490522:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 274 00000100:00100000:0.0:1783137868.490536:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:9944:x1869755299421312:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137868.491264:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+12:9944:x1869755299421312:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 725us (7965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137868.491276:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 274 00000100:00100000:0.0:1783137868.501708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137868.501805:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421440 00000100:00100000:1.0:1783137868.501825:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421440 00000100:00100000:1.0:1783137868.501924:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:1.0:1783137868.501937:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:9944:x1869755299421440:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137868.502402:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+12:9944:x1869755299421440:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 465us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.502773:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 275 00000100:00100000:1.0:1783137868.510614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137868.510810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421568 00000100:00100000:2.0:1783137868.510825:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421568 00000100:00100000:2.0:1783137868.510892:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:2.0:1783137868.510904:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:5582:x1869755299421568:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137868.510926:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137868.510950:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dc5684000/0x4691dfc3d66b7266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.510989:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dc5684000/0x4691dfc3d66b7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ab expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.511003:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dc5684000/0x4691dfc3d66b7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ab expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137868.511015:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684000, rc 0) 00000100:00100000:2.0:1783137868.511120:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299421568:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 217us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.511129:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 276 00000100:00100000:3.0:1783137868.516330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137868.520679:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421696 00000100:00100000:1.0:1783137868.520703:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421696 00000100:00100000:1.0:1783137868.520801:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:1.0:1783137868.520813:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299421696:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.521256:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299421696:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 443us (4948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.521265:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 277 00000100:00100000:1.0:1783137868.544020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137868.544732:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421824 00000100:00100000:0.0:1783137868.544749:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421824 00000100:00100000:0.0:1783137868.544831:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00100000:0.0:1783137868.544844:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299421824:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137868.546244:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:5582:x1869755299421824:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 1391us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.546259:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 278 00000100:00100000:0.0:1783137868.553789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137868.553877:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299421952 00000100:00100000:2.0:1783137868.553891:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299421952 00000100:00100000:2.0:1783137868.554035:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 279 00000100:00100000:2.0:1783137868.554048:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:9947:x1869755299421952:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137868.554413:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:9947:x1869755299421952:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 366us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137868.554422:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 279 00000100:00100000:3.0:1783137868.560283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137868.564796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422080 00000100:00100000:1.0:1783137868.564819:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422080 00000100:00100000:1.0:1783137868.564929:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 280 00000100:00100000:1.0:1783137868.564941:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:9947:x1869755299422080:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137868.566033:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:9947:x1869755299422080:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 1082us (5753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137868.566061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 280 00000040:00080000:2.0:1783137869.115838:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783137869.311744:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137869.499924:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322528128:0@lo:400:kworker.0 00000100:00100000:0.0:1783137869.500029:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137869.500117:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137869.500124:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322528000:0@lo:400:kworker.0 00000100:00100000:0.0:1783137869.500148:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137869.500164:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322528512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137869.500190:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137869.500225:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528128 00000100:00100000:0.0:1783137869.500234:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528128 00000100:00100000:0.0:1783137869.500292:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528000 00000100:00100000:0.0:1783137869.500295:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528000 00000100:00100000:0.0:1783137869.500319:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783137869.500329:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322528128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500525:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322528256:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137869.500628:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783137869.500634:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322527872:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500669:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137869.500692:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322528384:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137869.500737:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528512 00000100:00100000:1.0:1783137869.500741:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528512 00000100:00100000:1.0:1783137869.500783:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528256 00000100:00100000:1.0:1783137869.500786:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528256 00000100:00100000:1.0:1783137869.500809:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783137869.500816:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500859:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322528512:12345-0@lo:400:kworker.0 Request processed in 42us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137869.500866:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783137869.500886:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783137869.500892:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322528256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.500923:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322528256:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137869.500929:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1783137869.500975:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df5e5bb80 x1869755322528256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137869.500993:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322528256:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.501059:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528384 00000100:00100000:1.0:1783137869.501063:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528384 00000100:00100000:1.0:1783137869.501088:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783137869.501096:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322528000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.501130:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322528000:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137869.501137:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783137869.501150:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783137869.501156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322528384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.501188:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322528384:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137869.501194:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1783137869.501211:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137869.501217:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137869.501220:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137869.501242:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322528384:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.501297:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322528000:0@lo:400:kworker.0 00000100:00100000:1.0:1783137869.501311:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322528512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137869.501637:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322528128:12345-0@lo:400:kworker.0 Request processed in 1307us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137869.501646:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783137869.501723:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322528128:0@lo:400:kworker.0 00000100:00100000:2.0:1783137869.501966:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322527872 00000100:00100000:2.0:1783137869.501972:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322527872 00000100:00100000:2.0:1783137869.502019:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1783137869.502027:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322527872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137869.502090:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322527872:12345-0@lo:400:kworker.0 Request processed in 65us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137869.502097:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1783137869.502192:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322527872:0@lo:400:kworker.0 00000100:00100000:2.0:1783137870.014971:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137870.015007:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322528640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137870.015128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137870.015298:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528640 00000100:00100000:1.0:1783137870.015309:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528640 00000100:00100000:1.0:1783137870.015385:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137870.015398:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322528640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137870.015456:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137870.015565:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322528640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137870.015592:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783137870.016348:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322528640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137870.331028:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783137870.612131:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1783137871.354841:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137871.971211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137871.971299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137871.971337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137871.971374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137871.971406:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422336 00000100:00100000:0.0:1783137871.971416:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422336 00000100:00100000:0.0:1783137871.971502:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422592 00000100:00100000:0.0:1783137871.971505:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422592 00000100:00100000:0.0:1783137871.971526:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:0.0:1783137871.971535:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299422336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137871.971815:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299422336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 279us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137871.971824:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:0.0:1783137871.971843:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1783137871.971850:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299422592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137871.971875:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299422592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137871.971881:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00080000:0.0:1783137871.971899:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137871.972081:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422464 00000100:00100000:2.0:1783137871.972086:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422464 00000100:00100000:2.0:1783137871.972134:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1783137871.972141:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299422464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137871.972183:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299422464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137871.972190:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00080000:0.0:1783137871.973072:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137871.974790:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422208 00000100:00100000:1.0:1783137871.974802:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422208 00000100:00100000:1.0:1783137871.974871:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 282 00000100:00100000:1.0:1783137871.974881:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299422208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137871.974970:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299422208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 90us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137871.974977:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 282 00010000:00010000:2.0:1783137872.378811:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137872.570997:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137872.574780:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322528768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137872.575450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137872.575833:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528768 00000100:00100000:1.0:1783137872.575844:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528768 00000100:00100000:1.0:1783137872.575933:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137872.575943:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322528768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137872.575985:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137872.576047:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322528768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137872.576054:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1783137872.576129:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137872.576302:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d6680 x1869755322528768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137872.576338:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322528768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137873.408644:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137874.426823:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137874.619035:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322529280:0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.619062:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322529024:0@lo:400:kworker.0 00000100:00100000:2.0:1783137874.619160:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322528896:0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.620677:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137874.621157:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529024 00000100:00100000:0.0:1783137874.621239:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529024 00000100:00100000:0.0:1783137874.621296:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783137874.621306:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322529024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.621413:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322529536:0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.621540:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137874.622919:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137874.622936:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322529152:0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.622988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137874.623161:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137874.623213:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529536 00000100:00100000:1.0:1783137874.623219:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529536 00000100:00100000:3.0:1783137874.623253:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529152 00000100:00100000:3.0:1783137874.623259:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529152 00000100:00100000:1.0:1783137874.623285:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529280 00000100:00100000:1.0:1783137874.623291:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529280 00000100:00100000:3.0:1783137874.623311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783137874.623322:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322529152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137874.623324:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137874.623336:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137874.623389:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322529536:12345-0@lo:400:kworker.0 Request processed in 55us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137874.623405:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137874.623423:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137874.623431:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137874.623444:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322529152:12345-0@lo:400:kworker.0 Request processed in 123us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137874.623452:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783137874.623486:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322529280:12345-0@lo:400:kworker.0 Request processed in 56us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137874.623494:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1783137874.623510:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137874.623517:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137874.623520:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137874.623540:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322529152:0@lo:400:kworker.0 00000100:00100000:1.0:1783137874.623572:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1783137874.623598:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5df5e59880, transno 4294967300 00000100:00100000:1.0:1783137874.623610:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322529536:0@lo:400:kworker.0 00010000:00080000:1.0:1783137874.623643:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfa393100 x1869755322529280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137874.623653:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322529280:0@lo:400:kworker.0 00000100:00100000:0.0:1783137874.623882:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322529024:12345-0@lo:400:kworker.0 Request processed in 2577us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137874.623890:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783137874.624122:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322529024:0@lo:400:kworker.0 00000100:00100000:2.0:1783137874.624297:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137874.624342:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322529408:0@lo:400:kworker.0 00000100:00100000:2.0:1783137874.624371:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137874.624427:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529408 00000100:00100000:3.0:1783137874.624433:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529408 00000100:00100000:0.0:1783137874.624508:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322528896 00000100:00100000:3.0:1783137874.624509:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783137874.624515:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322528896 00000100:00100000:3.0:1783137874.624520:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137874.624575:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783137874.624583:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322528896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137874.624622:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322528896:12345-0@lo:400:kworker.0 Request processed in 40us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137874.624628:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783137874.624663:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322528896:0@lo:400:kworker.0 00000100:00080000:1.0:1783137874.624708:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137874.624822:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322529408:12345-0@lo:400:kworker.0 Request processed in 302us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137874.624829:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783137874.624888:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322529408:0@lo:400:kworker.0 00000100:00100000:3.0:1783137875.130841:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322529664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137875.130924:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137875.131144:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529664 00000100:00100000:1.0:1783137875.131154:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529664 00000100:00100000:1.0:1783137875.131225:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137875.131235:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322529664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137875.131275:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137875.131335:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322529664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137875.131343:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783137875.131407:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322529664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137875.451991:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137876.474834:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137877.091276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137877.091320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137877.091355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137877.091395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137877.091500:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422720 00000100:00100000:2.0:1783137877.091511:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422720 00000100:00100000:2.0:1783137877.091597:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 284 00000100:00100000:2.0:1783137877.091609:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299422720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137877.091686:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299422720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137877.091702:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 284 00000100:00100000:3.0:1783137877.091823:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422848 00000100:00100000:3.0:1783137877.091828:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422848 00000100:00100000:3.0:1783137877.091879:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423104 00000100:00100000:3.0:1783137877.091883:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423104 00000100:00100000:3.0:1783137877.091907:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:3.0:1783137877.091914:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299422848:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137877.091950:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299422848:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137877.091957:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:3.0:1783137877.091990:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:3.0:1783137877.091996:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299423104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137877.092023:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299423104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137877.092029:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:3.0:1783137877.092047:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299422976 00000100:00100000:3.0:1783137877.092051:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299422976 00000100:00100000:3.0:1783137877.092082:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:3.0:1783137877.092089:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299422976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137877.092115:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299422976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137877.092121:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00080000:2.0:1783137877.092314:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137877.092319:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137877.499877:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137877.690974:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137877.690997:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322529792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137877.691068:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137877.691306:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529792 00000100:00100000:3.0:1783137877.691316:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529792 00000100:00100000:3.0:1783137877.691380:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783137877.691391:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322529792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137877.691427:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137877.691492:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322529792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137877.691500:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1783137877.691591:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d6300 x1869755322529792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137877.691631:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322529792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137877.691911:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783137878.522930:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137879.355210:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137879.547481:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137879.739195:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322530048:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739272:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137879.739331:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322530560:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137879.739382:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137879.739382:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322530304:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739401:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322530176:0@lo:400:kworker.0 00000100:00100000:2.0:1783137879.739411:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137879.739435:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137879.739463:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783137879.739468:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322529920:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739470:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530048 00000100:00100000:3.0:1783137879.739477:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530048 00000100:00100000:2.0:1783137879.739495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137879.739512:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322530432:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739527:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530176 00000100:00100000:3.0:1783137879.739530:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530176 00000100:00100000:2.0:1783137879.739541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137879.739573:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530432 00000100:00100000:3.0:1783137879.739576:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530432 00000100:00100000:2.0:1783137879.739587:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530560 00000100:00100000:2.0:1783137879.739590:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530560 00000100:00100000:3.0:1783137879.739592:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783137879.739600:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322530048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137879.739613:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530304 00000100:00100000:2.0:1783137879.739615:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530304 00000100:00100000:2.0:1783137879.739632:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783137879.739649:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322530048:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137879.739656:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783137879.739673:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783137879.739679:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322530176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739719:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322530176:12345-0@lo:400:kworker.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137879.739725:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783137879.739733:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322530560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739736:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783137879.739741:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322530432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739765:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322530432:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137879.739765:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322530560:12345-0@lo:400:kworker.0 Request processed in 127us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137879.739772:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783137879.739772:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137879.739782:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137879.739788:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322530304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.739808:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322530176:0@lo:400:kworker.0 00000100:00100000:2.0:1783137879.739812:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322530304:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137879.739818:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322530048:0@lo:400:kworker.0 00000100:00100000:2.0:1783137879.739818:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783137879.739826:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322530560:0@lo:400:kworker.0 00000100:00080000:2.0:1783137879.739852:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137879.739856:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137879.739859:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137879.739921:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322529920 00000100:00100000:0.0:1783137879.739925:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322529920 00000100:00100000:0.0:1783137879.739955:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1783137879.739963:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322529920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137879.739995:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322529920:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137879.740001:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1783137879.740296:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322529920:0@lo:400:kworker.0 00000100:00100000:3.0:1783137879.740306:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322530432:0@lo:400:kworker.0 00010000:00080000:3.0:1783137879.740318:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df594d500 x1869755322530304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137879.740328:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322530304:0@lo:400:kworker.0 00000100:00100000:0.0:1783137880.251192:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322530688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137880.251281:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137880.251340:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530688 00000100:00100000:1.0:1783137880.251349:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530688 00000100:00100000:1.0:1783137880.251423:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783137880.251433:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322530688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137880.251470:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137880.251535:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322530688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137880.251581:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783137880.251672:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322530688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137880.572226:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137881.595434:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137882.214461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137882.214519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137882.214672:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423232 00000100:00100000:2.0:1783137882.214682:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423232 00000100:00100000:2.0:1783137882.214737:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:2.0:1783137882.214748:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299423232:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137882.214821:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299423232:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137882.214829:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 286 00000100:00100000:3.0:1783137882.214917:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423360 00000100:00100000:3.0:1783137882.214921:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423360 00000100:00100000:3.0:1783137882.214979:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:3.0:1783137882.214988:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299423360:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137882.215021:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299423360:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137882.215027:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00080000:2.0:1783137882.215084:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137882.225972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137882.226133:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423488 00000100:00100000:2.0:1783137882.226145:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423488 00000100:00100000:2.0:1783137882.226229:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:2.0:1783137882.226240:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2349:x1869755299423488:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:2.0:1783137882.226277:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b71a2 00000100:00080000:2.0:1783137882.226286:0:6617:0:(import.c:65:import_set_state_nolock()) ffff8e5df5964000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137882.226332:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1783137882.226774:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+2:2349:x1869755299423488:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 534us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137882.226782:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00010000:00010000:1.0:1783137882.226859:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783137882.228082:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137882.229942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137882.230099:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423616 00000100:00100000:1.0:1783137882.230109:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423616 00000100:00100000:1.0:1783137882.230186:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:1.0:1783137882.230196:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299423616:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137882.230283:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299423616:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137882.230291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00080000:0.0:1783137882.231072:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137882.618769:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137882.814240:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137882.814270:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322530816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137882.814352:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137882.815046:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530816 00000100:00100000:3.0:1783137882.815056:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530816 00000100:00100000:3.0:1783137882.815188:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783137882.815200:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322530816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137882.817433:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137882.817541:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322530816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2342us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137882.817566:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1783137882.818212:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dff7d5880 x1869755322530816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137882.818234:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322530816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137882.820815:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783137883.642902:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137884.668949:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137884.858929:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322531200:0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859000:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137884.859067:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137884.859074:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322531072:0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859098:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137884.859116:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322531584:0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859164:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137884.859197:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531200 00000100:00100000:0.0:1783137884.859204:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531200 00000100:00100000:0.0:1783137884.859253:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531072 00000100:00100000:0.0:1783137884.859256:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531072 00000100:00100000:0.0:1783137884.859279:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783137884.859288:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322531200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859346:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322531200:12345-0@lo:400:kworker.0 Request processed in 58us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137884.859354:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322531328:0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859357:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783137884.859388:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783137884.859397:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322531072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859406:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137884.859433:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137884.859436:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322531072:12345-0@lo:400:kworker.0 Request processed in 41us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137884.859447:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783137884.859453:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322530944:0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859503:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322531072:0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137884.859522:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322531200:0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859538:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322531456:0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859592:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137884.859596:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322530944 00000100:00100000:0.0:1783137884.859601:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322530944 00000100:00100000:0.0:1783137884.859634:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1783137884.859636:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531456 00000100:00100000:3.0:1783137884.859641:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531456 00000100:00100000:0.0:1783137884.859643:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322530944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859675:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783137884.859684:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322531456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137884.859690:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322530944:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137884.859699:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1783137884.859723:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322531456:12345-0@lo:400:kworker.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137884.859731:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783137884.859770:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322530944:0@lo:400:kworker.0 00000100:00100000:3.0:1783137884.859781:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322531456:0@lo:400:kworker.0 00000100:00100000:1.0:1783137884.859810:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531584 00000100:00100000:1.0:1783137884.859817:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531584 00000100:00100000:1.0:1783137884.859854:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531328 00000100:00100000:1.0:1783137884.859857:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531328 00000100:00100000:1.0:1783137884.859884:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783137884.859892:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322531584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137884.859943:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322531584:12345-0@lo:400:kworker.0 Request processed in 53us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137884.859950:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783137884.859965:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783137884.859971:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322531328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137884.860005:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322531328:12345-0@lo:400:kworker.0 Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137884.860011:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1783137884.860039:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfa391f80 x1869755322531328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137884.860051:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322531328:0@lo:400:kworker.0 00000100:00100000:1.0:1783137884.860077:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322531584:0@lo:400:kworker.0 00000100:00080000:2.0:1783137884.860304:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137884.860308:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137884.860311:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137885.372094:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137885.372119:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322531712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137885.372198:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137885.372267:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531712 00000100:00100000:1.0:1783137885.372275:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531712 00000100:00100000:1.0:1783137885.372324:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783137885.372334:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322531712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137885.372382:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137885.372428:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322531712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137885.372436:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783137885.372482:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322531712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137885.690942:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783137885.970811:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137885.970823:0:7522:0:(genops.c:906:class_export_put()) final put ffff8e5df5965000/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137885.970865:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5965000/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-OST0001 00000020:00000080:2.0:1783137885.970929:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5df5964000 for lustre-OST0001 00010000:00010000:2.0:1783137886.718305:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137887.330452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137887.330517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137887.330592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137887.330623:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423744 00000100:00100000:3.0:1783137887.330632:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423744 00000100:00100000:3.0:1783137887.330679:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00100000:3.0:1783137887.330688:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299423744:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137887.330756:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299423744:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137887.330762:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 288 00000100:00100000:3.0:1783137887.330795:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299423872 00000100:00100000:3.0:1783137887.330798:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299423872 00000100:00100000:3.0:1783137887.330839:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424000 00000100:00100000:3.0:1783137887.330841:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424000 00000100:00100000:3.0:1783137887.330860:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:3.0:1783137887.330867:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299423872:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137887.330899:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299423872:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137887.330906:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:3.0:1783137887.330931:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:3.0:1783137887.330938:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299424000:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137887.330961:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2350:x1869755299424000:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137887.330967:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00080000:3.0:1783137887.331087:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137887.738695:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137887.931796:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137887.931819:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322531840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137887.931897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137887.931970:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531840 00000100:00100000:3.0:1783137887.931978:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531840 00000100:00100000:3.0:1783137887.932046:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783137887.932056:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322531840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137887.932094:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137887.932139:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322531840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137887.932146:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1783137887.932180:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783137887.932210:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc5ee4a80 x1869755322531840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137887.932243:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322531840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137888.763184:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137889.603835:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783137889.791494:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137889.979021:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322531968:0@lo:400:kworker.0 00000100:00100000:3.0:1783137889.979100:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137889.979211:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322531968 00000100:00100000:2.0:1783137889.979220:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322531968 00000100:00100000:2.0:1783137889.979274:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783137889.979283:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322531968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980122:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322532352:0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137889.980232:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322532096:0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980587:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137889.980612:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137889.980620:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322532224:0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980643:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137889.980670:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532096 00000100:00100000:0.0:1783137889.980675:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532096 00000100:00100000:0.0:1783137889.980727:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532224 00000100:00100000:0.0:1783137889.980731:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532224 00000100:00100000:0.0:1783137889.980760:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783137889.980768:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322532096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980813:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322532096:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137889.980821:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783137889.980842:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783137889.980848:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322532224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980875:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322532224:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137889.980880:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1783137889.980898:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137889.980924:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322532224:0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980932:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322532096:0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.980971:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532352 00000100:00100000:0.0:1783137889.980974:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532352 00000100:00100000:0.0:1783137889.981004:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783137889.981017:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322532352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.981051:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322532352:12345-0@lo:400:kworker.0 Request processed in 34us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137889.981056:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783137889.981072:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783137889.981090:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df594f100 x1869755322532352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137889.981101:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322532352:0@lo:400:kworker.0 00000100:00100000:2.0:1783137889.985419:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322531968:12345-0@lo:400:kworker.0 Request processed in 6125us (6307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137889.985566:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1783137889.985758:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322531968:0@lo:400:kworker.0 00000100:00100000:3.0:1783137889.986915:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322532480:0@lo:400:kworker.0 00000100:00100000:3.0:1783137889.986983:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137889.987210:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137889.987236:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322532608:0@lo:400:kworker.0 00000100:00100000:2.0:1783137889.987275:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137889.987394:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532608 00000100:00100000:3.0:1783137889.987401:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532608 00000100:00100000:3.0:1783137889.987482:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783137889.987493:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137889.987572:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322532608:12345-0@lo:400:kworker.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137889.987579:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783137889.987620:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322532608:0@lo:400:kworker.0 00000100:00080000:1.0:1783137889.987761:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137889.988055:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532480 00000100:00100000:0.0:1783137889.988061:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532480 00000100:00100000:0.0:1783137889.988150:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783137889.988159:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322532480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137889.988213:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322532480:12345-0@lo:400:kworker.0 Request processed in 56us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137889.988231:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783137889.988327:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322532480:0@lo:400:kworker.0 00000100:00080000:1.0:1783137889.988621:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137890.491117:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322532736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137890.491185:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137890.493416:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532736 00000100:00100000:0.0:1783137890.493440:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532736 00000100:00100000:0.0:1783137890.493505:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783137890.493515:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322532736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137890.493586:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137890.493670:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322532736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137890.493678:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783137890.493794:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322532736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137890.812266:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137891.500535:0:11733:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:04:49 (1783137889) 00010000:00010000:3.0:1783137891.834745:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137892.459207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137892.459256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137892.459299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137892.459603:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424128 00000100:00100000:3.0:1783137892.459613:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424128 00000100:00100000:3.0:1783137892.459669:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 290 00000100:00100000:3.0:1783137892.459680:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299424128:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137892.459748:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299424128:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 70us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137892.459784:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 290 00000100:00100000:1.0:1783137892.463782:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424384 00000100:00100000:1.0:1783137892.463797:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424384 00000100:00100000:1.0:1783137892.463886:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424256 00000100:00100000:1.0:1783137892.463890:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424256 00000100:00100000:1.0:1783137892.463930:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:1.0:1783137892.463941:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299424384:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137892.463947:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:3.0:1783137892.463955:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299424256:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137892.464024:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299424384:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 84us (4766us total) trans 0 rc 0/0 00000100:00080000:2.0:1783137892.464030:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137892.464031:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:3.0:1783137892.469758:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299424256:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 5791us (10446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137892.470034:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 143 00010000:00010000:2.0:1783137892.859895:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137893.050989:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322532864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137893.051096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137893.053767:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532864 00000100:00100000:3.0:1783137893.053789:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532864 00000100:00100000:3.0:1783137893.053910:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783137893.053925:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322532864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137893.053980:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137893.054099:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322532864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137893.054107:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1783137893.054159:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dc5ee7800 x1869755322532864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137893.054353:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322532864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137893.054450:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137893.463184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137893.463392:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424512 00000100:00100000:1.0:1783137893.463406:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424512 00000100:00100000:1.0:1783137893.463492:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:1.0:1783137893.463505:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:10218:x1869755299424512:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137893.463534:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137893.463595:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b726d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225b2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.463699:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.463719:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.463737:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137893.464039:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783137893.464043:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137893.464175:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.464210:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b726d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b2 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.464587:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b2 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137893.464599:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:1.0:1783137893.464603:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137893.464607:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d600, rc 0) 00000100:00100000:1.0:1783137893.464696:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:10218:x1869755299424512:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1193us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137893.464706:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:1.0:1783137893.475700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137893.476080:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424640 00000100:00100000:0.0:1783137893.476093:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424640 00000100:00100000:0.0:1783137893.476239:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:0.0:1783137893.476253:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:10219:x1869755299424640:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137893.476282:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137893.476320:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b727b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225b9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476419:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476434:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476445:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476464:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476470:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.476475:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477042:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477062:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477068:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137893.477154:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783137893.477159:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137893.477250:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477264:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477271:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477279:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477284:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137893.477290:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477299:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477325:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:0.0:1783137893.477330:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137893.477335:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477353:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477371:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477378:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477384:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477390:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137893.477393:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477399:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477405:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137893.477407:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137893.477408:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477413:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477446:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b727b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b9 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477455:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b9 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137893.477465:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5dcc9ec200) 00010000:00010000:0.0:1783137893.477467:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137893.477469:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031600, rc 0) 00000100:00100000:0.0:1783137893.477627:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:10219:x1869755299424640:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1375us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137893.477635:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1783137893.515314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137893.522654:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299424896 00000100:00100000:2.0:1783137893.522678:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299424896 00000100:00100000:2.0:1783137893.522790:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1783137893.522802:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:10219:x1869755299424896:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137893.522829:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137893.523262:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b7297 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.523647:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.523687:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.523703:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.530426:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.530453:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.530467:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.531823:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b72ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.531842:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b72ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.531851:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b72ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137893.531864:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783137893.532197:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532206:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532213:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532227:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137893.532233:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532241:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532254:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5dcc9ec200) 00010000:00010000:2.0:1783137893.532257:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137893.532262:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532268:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b729e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532284:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532290:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532295:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532300:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137893.532314:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532320:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532807:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137893.532811:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137893.532815:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.532822:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b72a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.533526:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b7297 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225c0 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.533631:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b72ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225c0 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137893.533639:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:2.0:1783137893.533642:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137893.533644:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685200, rc 0) 00000100:00100000:2.0:1783137893.533736:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:10219:x1869755299424896:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 10936us (18904us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783137893.533745:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1783137893.542196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137893.542353:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425024 00000100:00100000:3.0:1783137893.542364:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425024 00000100:00100000:3.0:1783137893.542431:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:3.0:1783137893.542444:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+9:10219:x1869755299425024:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783137893.542606:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+9:10219:x1869755299425024:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 164us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137893.542613:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000040:00080000:2.0:1783137893.691440:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137893.886994:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137894.906826:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137895.105806:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322532992:0@lo:400:kworker.0 00000100:00100000:3.0:1783137895.105931:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137895.106160:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322532992 00000100:00100000:2.0:1783137895.106172:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322532992 00000100:00100000:2.0:1783137895.106239:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1783137895.106250:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322532992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106539:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322533376:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106606:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137895.106636:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137895.106642:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322533504:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106669:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137895.106699:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322533120:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106727:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137895.106744:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322533632:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106764:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137895.106780:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137895.106785:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322533248:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106808:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137895.106840:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533376 00000100:00100000:0.0:1783137895.106845:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533376 00000100:00100000:0.0:1783137895.106894:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533632 00000100:00100000:0.0:1783137895.106898:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533632 00000100:00100000:0.0:1783137895.106926:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137895.106935:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322533376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.106990:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322533376:12345-0@lo:400:kworker.0 Request processed in 57us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137895.106998:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137895.107017:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137895.107024:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107056:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322533632:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137895.107063:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137895.107086:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533504 00000100:00100000:0.0:1783137895.107090:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533504 00000100:00100000:0.0:1783137895.107118:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533120 00000100:00100000:0.0:1783137895.107121:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533120 00000100:00100000:0.0:1783137895.107133:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533248 00000100:00100000:0.0:1783137895.107135:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533248 00000100:00100000:0.0:1783137895.107153:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783137895.107160:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322533504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107194:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322533504:12345-0@lo:400:kworker.0 Request processed in 34us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137895.107201:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783137895.107214:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783137895.107220:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322533120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107247:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322533120:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137895.107253:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783137895.107265:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783137895.107270:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322533248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107325:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322533248:12345-0@lo:400:kworker.0 Request processed in 54us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137895.107332:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1783137895.107363:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137895.107368:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137895.107371:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137895.107427:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322533504:0@lo:400:kworker.0 00010000:00080000:0.0:1783137895.107444:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfa393800 x1869755322533376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137895.107456:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322533376:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107493:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322533248:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107503:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322533120:0@lo:400:kworker.0 00000100:00100000:0.0:1783137895.107511:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322533632:0@lo:400:kworker.0 00000100:00100000:2.0:1783137895.111471:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3315:x1869755322532992:12345-0@lo:400:kworker.0 Request processed in 5207us (5525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137895.111500:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783137895.112103:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83444777-5c31-482f-a1f5-fb6cbc8d0848:3315:1869755322532992:0@lo:400:kworker.0 00000100:00100000:2.0:1783137895.614532:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137895.614582:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322533760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137895.614680:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137895.614826:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322533760 00000100:00100000:1.0:1783137895.614836:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322533760 00000100:00100000:1.0:1783137895.614916:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783137895.614928:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322533760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137895.614983:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137895.615058:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322533760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137895.615066:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783137895.615151:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322533760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137895.933433:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137896.107881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137896.108073:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425152 00000100:00100000:1.0:1783137896.108094:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425152 00000100:00100000:1.0:1783137896.108166:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:1.0:1783137896.108178:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:10262:x1869755299425152:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137896.108198:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137896.108218:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b72ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225c7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108294:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108309:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108329:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108344:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108351:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108358:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108645:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108655:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108662:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108673:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137896.108678:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108686:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108699:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:1.0:1783137896.108702:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137896.108706:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108712:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b72c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108724:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108730:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108736:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108741:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137896.108743:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108749:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108767:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e5dc5113200) 00010000:00010000:1.0:1783137896.108770:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137896.108773:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108777:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b72c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108808:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b72ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225c7 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108817:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:1.0:1783137896.108819:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137896.108823:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b72ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225c7 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.108831:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c400, rc 0) 00000100:00080000:2.0:1783137896.108956:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137896.110966:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:10262:x1869755299425152:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2782us (3086us total) trans 0 rc 301/301 00000100:00100000:1.0:1783137896.110978:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1783137896.123729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.130793:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425408 00000100:00100000:2.0:1783137896.130806:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425408 00000100:00100000:2.0:1783137896.130869:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:2.0:1783137896.130879:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:10262:x1869755299425408:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:2.0:1783137896.130936:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137896.130969:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7274 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b2 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.130988:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc5113a00) 00010000:00010000:2.0:1783137896.131000:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137896.131269:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.131295:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.131306:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.131319:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.131338:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.131346:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137896.138430:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783137896.138457:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138469:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138476:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138483:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137896.138488:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138497:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138514:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1cd00) 00010000:00010000:2.0:1783137896.138517:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137896.138522:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.138528:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b72cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137896.138582:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2bba49b reply state 00000000110c8d1c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137896.138592:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137896.138708:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+10:10262:x1869755299425408:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 7825us (14981us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783137896.138717:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00010000:00010000:3.0:1783137896.140684:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140700:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140708:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140714:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137896.140719:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140727:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140743:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e5de2d1c700) 00010000:00010000:3.0:1783137896.140746:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137896.140750:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.140756:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b72d6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137896.179671:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1783137896.288322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137896.288839:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425536 00000100:00100000:3.0:1783137896.288864:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425536 00000100:00100000:3.0:1783137896.294040:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1783137896.294065:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:10270:x1869755299425536:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:3.0:1783137896.294091:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137896.294116:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294185:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294198:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294209:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137896.294272:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783137896.294276:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137896.294331:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294356:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ce expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294377:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ce expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.294385:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:3.0:1783137896.294388:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137896.294390:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783137896.294486:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:10270:x1869755299425536:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 433us (6185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137896.294494:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1783137896.423789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.426496:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425664 00000100:00100000:2.0:1783137896.426517:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425664 00000100:00100000:3.0:1783137896.430393:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137896.430417:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+9:10276:x1869755299425664:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783137896.430450:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137896.430485:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b72eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225d5 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430609:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430628:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430642:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430659:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430667:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.430674:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431032:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431067:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431075:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137896.431122:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783137896.431127:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137896.431180:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431195:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431202:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431210:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431217:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137896.431222:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431231:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431246:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:3.0:1783137896.431250:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137896.431256:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431274:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b72f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431306:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431313:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431318:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431324:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137896.431327:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431334:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431343:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137896.431346:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137896.431349:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431355:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b72f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431459:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b72eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225d5 expref: 11 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431476:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225d5 expref: 10 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.431490:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137896.431492:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783137896.431495:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6200, rc 0) 00000100:00100000:3.0:1783137896.431858:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+10:10276:x1869755299425664:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1446us (8323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137896.431868:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137896.440756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137896.440871:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299425920 00000100:00100000:1.0:1783137896.440888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299425920 00000100:00100000:1.0:1783137896.441052:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:1.0:1783137896.441066:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+10:10276:x1869755299425920:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137896.441096:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137896.441127:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7307 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225dc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.441389:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.441409:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.441425:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.443056:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.443081:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.443170:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137896.444277:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783137896.444501:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444515:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444525:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444604:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444626:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444633:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444640:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137896.444645:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444652:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444787:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137896.444790:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137896.444796:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444803:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b730e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137896.444817:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c82133b8 reply state 000000008ece0bb0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137896.444827:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783137896.444976:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7307 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.444996:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.445016:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137896.445018:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137896.445021:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d800, rc 0) 00000100:00100000:1.0:1783137896.445238:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+13:10276:x1869755299425920:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4172us (4488us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783137896.445247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00010000:00010000:3.0:1783137896.451924:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.451952:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.451963:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.451971:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137896.451978:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.451990:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.452014:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc5113200) 00010000:00010000:3.0:1783137896.452019:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137896.452025:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.452032:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7315 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137896.455160:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.455316:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426048 00000100:00100000:0.0:1783137896.455331:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426048 00000100:00100000:0.0:1783137896.455410:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1783137896.455421:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1869755299426048:12345-192.168.202.24@tcp:8:bash.0 00010000:00080000:0.0:1783137896.455465:0:7801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1783137896.455518:0:7801:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b732a 00002000:00100000:0.0:1783137896.455535:0:7801:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75742c0b-74ec-412f-af86-0dbffc92280b/ffff8e5dc57b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783137896.456023:0:7801:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783137896.456348:0:7801:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783137896.456397:0:7801:0:(import.c:65:import_set_state_nolock()) ffff8e5dc57b7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137896.457194:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299426048:12345-192.168.202.24@tcp:8:bash.0 Request processed in 1766us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137896.457207:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1783137896.461178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.461859:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426176 00000100:00100000:2.0:1783137896.461876:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426176 00000100:00100000:2.0:1783137896.462018:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1783137896.462032:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:0:x1869755299426176:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137896.462058:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137896.462094:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225e3 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137896.462134:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137896.462169:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1783137896.462175:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137896.462189:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.462215:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.462255:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684200, rc 0) 00000100:00100000:2.0:1783137896.462387:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:0:x1869755299426176:12345-192.168.202.24@tcp:101:bash.0 Request processed in 346us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137896.462396:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00080000:0.0:1783137896.464035:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137896.466405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.466665:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426304 00000100:00100000:0.0:1783137896.466678:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426304 00000100:00100000:0.0:1783137896.466798:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1783137896.466811:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:10276:x1869755299426304:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137896.466838:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137896.466868:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225ea expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.466908:0:7801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 8 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.466918:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137896.466923:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137896.466929:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.466972:0:7801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 8 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.466990:0:7801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 8 pid: 6617 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137896.467035:0:7801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7801:1869755322533888:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137896.467187:0:7801:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021da80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137896.472235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.472452:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426432 00000100:00100000:2.0:1783137896.472468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426432 00010000:00010000:2.0:1783137896.472533:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 9 pid: 6617 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137896.472637:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:2.0:1783137896.472650:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2353:x1869755299426432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137896.472672:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137896.472714:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 9 pid: 6617 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.472734:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 9 pid: 6617 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.472774:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137896.472781:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137896.472793:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.472832:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.472888:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137896.472909:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1869755322534016:192.168.202.24@tcp:105: 00000100:00100000:2.0:1783137896.473042:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dffe32540 going to sleep for 11 seconds 00010000:00010000:0.0:1783137896.475460:0:7801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cc1780/0x4691dfc3d66b7331 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225e3 expref: 9 pid: 6617 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137896.475498:0:7801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7801:1869755322533888:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137896.475584:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.475604:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030200, rc 0) 00000100:00100000:0.0:1783137896.475711:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+8:10276:x1869755299426304:12345-192.168.202.24@tcp:101:bash.0 Request processed in 8902us (9332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137896.475721:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1783137896.476939:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1869755322534016:192.168.202.24@tcp:105: 00010000:00010000:2.0:1783137896.476969:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137896.477029:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299426432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4381us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137896.477039:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:2.0:1783137896.480779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.480906:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426688 00000100:00100000:0.0:1783137896.480925:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426688 00000100:00100000:0.0:1783137896.481015:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783137896.481030:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+12:10276:x1869755299426688:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1783137896.481634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+13:10276:x1869755299426688:12345-192.168.202.24@tcp:35:bash.0 Request processed in 606us (869us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783137896.481644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1783137896.619640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.620182:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299426944 00000100:00100000:2.0:1783137896.620193:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299426944 00000100:00100000:2.0:1783137896.620340:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1783137896.620351:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+13:10286:x1869755299426944:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137896.620388:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137896.620412:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b733f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225f1 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137896.620530:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783137896.620696:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b733f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225f1 expref: 15 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.620721:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:2.0:1783137896.620724:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137896.620729:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b733f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225f1 expref: 15 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137896.620746:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685a00, rc 0) 00000100:00100000:2.0:1783137896.620897:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:10286:x1869755299426944:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 547us (1268us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1783137896.620905:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:1.0:1783137896.629253:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.629454:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299427200 00000100:00100000:2.0:1783137896.629465:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299427200 00000100:00100000:2.0:1783137896.629584:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1783137896.629595:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+14:10286:x1869755299427200:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137896.629893:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+15:10286:x1869755299427200:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 299us (651us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783137896.629900:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1783137896.720640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137896.720777:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299427328 00000100:00100000:3.0:1783137896.720786:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299427328 00000100:00100000:3.0:1783137896.720841:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1783137896.720851:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+15:10292:x1869755299427328:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137896.720884:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137896.720904:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b734d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225f8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.720971:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.720987:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.720999:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137896.721068:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783137896.721072:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137896.721101:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.721126:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b734d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225f8 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.721146:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225f8 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.721172:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137896.721175:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137896.721179:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6400, rc 0) 00000100:00100000:3.0:1783137896.721252:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+16:10292:x1869755299427328:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 402us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137896.721268:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1783137896.726309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.726602:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299427584 00000100:00100000:0.0:1783137896.726612:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299427584 00000100:00100000:0.0:1783137896.726672:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1783137896.726691:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+16:10292:x1869755299427584:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137896.726712:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137896.726733:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b735b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239225ff expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.726843:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.726858:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.726882:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137896.726893:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783137896.727043:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b735b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ff expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.727061:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ff expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.727068:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:0.0:1783137896.727071:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137896.727074:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137896.727126:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+18:10292:x1869755299427584:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 436us (827us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783137896.727132:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:2.0:1783137896.735326:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.735375:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137896.735576:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299427968 00000100:00100000:3.0:1783137896.735587:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299427968 00000100:00100000:3.0:1783137896.735639:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:3.0:1783137896.735649:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+18:10292:x1869755299427968:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137896.735674:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137896.735695:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7370 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922606 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.735795:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.735809:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.735821:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137896.735834:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783137896.735976:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7370 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922606 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.737011:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922606 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.737805:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:3.0:1783137896.737809:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783137896.737813:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7000, rc 0) 00000100:00100000:3.0:1783137896.738777:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:10292:x1869755299427968:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 3121us (3393us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783137896.738789:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1783137896.740527:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299427712 00000100:00100000:1.0:1783137896.740580:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299427712 00000100:00100000:1.0:1783137896.740653:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1783137896.740671:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+20:2353:x1869755299427712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137896.740686:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137896.740721:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ff expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.740743:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137896.740753:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137896.740833:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:2353:x1869755299427712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 172us (5518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137896.740841:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1783137896.744820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.744970:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428096 00000100:00100000:0.0:1783137896.744981:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428096 00000100:00100000:0.0:1783137896.745066:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1783137896.745076:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299428096:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:0.0:1783137896.745129:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.745151:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.745160:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137896.745164:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137896.745169:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.745212:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.745229:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 7 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137896.745246:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322534144:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137896.745361:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021da80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137896.748114:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322534144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137896.748144:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137896.751478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137896.755132:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428224 00000100:00100000:3.0:1783137896.755146:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428224 00002000:00100000:3.0:1783137896.755203:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e5dc8778e00 x1869755299428224/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:47/0 lens 504/0 e 0 to 0 dl 1783137907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137896.755214:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dc8778e00 with x1869755299428224 ext(0->12) 00010000:00010000:3.0:1783137896.755223:0:6620:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 8 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.755242:0:6620:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 8 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137896.755250:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dc8778e00 00000100:00100000:3.0:1783137896.755311:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1783137896.756618:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299428224:12345-192.168.202.24@tcp:4:lfs.0 00000001:00100000:3.0:1783137896.813440:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000100:00100000:1.0:1783137896.814819:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299428224:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 58830us (63342us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783137896.814850:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00002000:00100000:1.0:1783137896.814881:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e5dc8778e00 x1869755299428224/t4294967299(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:47/0 lens 504/448 e 0 to 0 dl 1783137907 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137896.814891:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dc8778e00 with x1869755299428224 ext(0->12) 00010000:00010000:1.0:1783137896.814902:0:6620:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.814921:0:6620:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137896.814929:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dc8778e00 00000100:00100000:2.0:1783137896.818936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137896.819347:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428352 00000100:00100000:1.0:1783137896.819358:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428352 00010000:00010000:1.0:1783137896.819411:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137896.819452:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:1.0:1783137896.819462:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:2353:x1869755299428352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137896.819478:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783137896.819497:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783137896.819500:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783137895 00002000:00010000:1.0:1783137896.819502:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783137895 00002000:00010000:1.0:1783137896.819505:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783137895 00010000:00010000:1.0:1783137896.819511:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.819524:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.820010:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b7338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ea expref: 9 pid: 7801 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.820103:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137896.820108:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137896.820113:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.820124:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.820150:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137896.820297:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820326:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820356:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820365:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820381:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820388:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137896.820393:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820402:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820415:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.820422:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b7385 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137896.820499:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2353:x1869755299428352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1037us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137896.820508:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1783137896.823289:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299428096:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 78188us (78453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137896.823304:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:3.0:1783137896.829458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.829535:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428608 00000100:00100000:0.0:1783137896.829572:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428608 00000100:00100000:0.0:1783137896.829631:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1783137896.829642:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:10292:x1869755299428608:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:0.0:1783137896.829710:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922606 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137896.830184:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1783137896.830247:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1783137896.832769:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1783137896.832876:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.832897:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.832906:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.832944:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.832960:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 23 pid: 5812 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137896.832988:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1869755322534272:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137896.834800:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021d840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137896.840927:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1869755322534272:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137896.840959:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137896.842228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137896.842385:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428736 00000100:00100000:1.0:1783137896.842393:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428736 00010000:00010000:1.0:1783137896.842432:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 24 pid: 5812 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137896.842516:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1783137896.842533:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+24:2352:x1869755299428736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137896.842582:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137896.842591:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 24 pid: 5812 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842602:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 24 pid: 5812 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842630:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b731c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225dc expref: 24 pid: 5812 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842647:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137896.842756:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842768:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842777:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.842811:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137896.842873:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+23:2352:x1869755299428736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 341us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137896.842881:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00010000:00010000:3.0:1783137896.843079:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137896.843087:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137896.843206:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1783137896.843459:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1783137896.843622:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1869755322534400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137896.845938:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137896.846032:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137896.851138:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322534400 00000100:00100000:1.0:1783137896.851152:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322534400 00000100:00100000:1.0:1783137896.851211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137896.851220:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1869755322534400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783137896.851368:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1869755322534400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (5509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137896.851375:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137896.851501:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1869755322534400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137896.852193:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1783137896.852271:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1869755322534528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137896.852324:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137896.852348:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021d840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137896.853587:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322534528 00000100:00100000:1.0:1783137896.853600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322534528 00000100:00100000:1.0:1783137896.853658:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137896.853669:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1869755322534528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783137896.853934:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1869755322534528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 267us (1609us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783137896.853942:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783137896.854494:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1869755322534528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137896.854604:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1783137896.854658:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854668:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854675:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854681:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137896.854686:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854693:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854710:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:0.0:1783137896.854721:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783137896.854725:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.854731:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b738c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137896.854937:0:5815:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783137896.855739:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783137896.855755:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386748209746ns, next at 387748207033ns, rc = 0 00000001:00080000:0.0:1783137896.855764:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1783137896.855813:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113e00) 00010000:00010000:0.0:1783137896.855817:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783137896.855826:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922606 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137896.856232:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+26:10292:x1869755299428608:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 26589us (26781us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783137896.856242:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000020:00080000:0.0:1783137896.856248:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783137896.873783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137896.874490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299428864 00000100:00100000:0.0:1783137896.874502:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299428864 00000100:00100000:0.0:1783137896.874595:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:0.0:1783137896.874605:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+26:10292:x1869755299428864:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137896.874631:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137896.874665:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392260d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.874725:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392260d expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137896.874754:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392260d expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137896.874986:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137896.874990:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137896.874994:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:1.0:1783137896.875064:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+27:10292:x1869755299428864:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 460us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137896.875071:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:1.0:1783137896.882336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137896.882499:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299429120 00000100:00100000:2.0:1783137896.882509:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299429120 00000100:00100000:2.0:1783137896.882826:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1783137896.882838:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc60e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:10292:x1869755299429120:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137896.883065:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc60e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+28:10292:x1869755299429120:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 229us (738us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1783137896.883073:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00010000:00010000:0.0:1783137896.954786:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137897.039165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.039422:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299429376 00000100:00100000:0.0:1783137897.039433:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299429376 00000100:00100000:0.0:1783137897.039642:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1783137897.039661:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+28:10302:x1869755299429376:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137897.039683:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137897.039702:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b739a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922614 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137897.039826:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783137897.040034:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b739a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922614 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.040050:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:0.0:1783137897.040053:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137897.040059:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b739a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922614 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.040074:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030c00, rc 0) 00000100:00100000:0.0:1783137897.040129:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:10302:x1869755299429376:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 470us (975us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1783137897.040137:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:3.0:1783137897.045778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137897.046204:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299429504 00000100:00100000:2.0:1783137897.046214:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299429504 00000100:00100000:2.0:1783137897.046289:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:2.0:1783137897.046301:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+29:10302:x1869755299429504:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:2.0:1783137897.046395:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046421:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046434:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046450:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046456:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046464:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046620:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046663:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046671:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137897.046719:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046731:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046737:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046743:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046748:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137897.046752:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046759:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046773:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137897.046776:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137897.046782:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046788:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b73a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046811:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046818:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046823:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046828:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137897.046831:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046836:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046844:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5de2d1c900) 00010000:00010000:2.0:1783137897.046847:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137897.046850:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046855:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046875:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046880:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046885:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046897:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137897.046900:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046906:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046915:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:2.0:1783137897.046917:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137897.046920:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.046926:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b73b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137897.047198:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+29:10302:x1869755299429504:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 896us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137897.047208:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1783137897.054200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.054490:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299429760 00000100:00100000:0.0:1783137897.054517:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299429760 00000100:00100000:0.0:1783137897.054617:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:0.0:1783137897.054628:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:10302:x1869755299429760:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137897.055176:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+30:10302:x1869755299429760:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 548us (986us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783137897.055185:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1783137897.125585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.126268:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299430016 00000100:00100000:0.0:1783137897.126292:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299430016 00000100:00100000:0.0:1783137897.126368:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1783137897.126491:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+30:10305:x1869755299430016:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137897.126520:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137897.126542:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b73bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392261b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126685:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126701:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126715:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126731:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126739:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.126746:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127106:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127115:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127122:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137897.127133:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783137897.127233:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127241:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127248:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127254:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137897.127258:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127266:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127289:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137897.127293:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137897.127297:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127314:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b73c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127331:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127337:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127342:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127346:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137897.127349:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127355:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127361:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137897.127364:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137897.127366:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127381:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b73cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127427:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b73bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127442:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.127455:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137897.127457:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137897.127460:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137897.127540:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:10305:x1869755299430016:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1052us (2003us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1783137897.135344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137897.136365:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299430144 00000100:00100000:2.0:1783137897.136379:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299430144 00000100:00100000:0.0:1783137897.137213:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:2.0:1783137897.137449:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1783137897.138342:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+32:10305:x1869755299430144:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1783137897.138716:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138733:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138745:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138791:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138798:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138805:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138812:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137897.138816:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138824:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138836:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:2.0:1783137897.138840:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137897.138845:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.138852:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b73e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137897.139122:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+32:10305:x1869755299430144:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 693us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137897.139132:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1783137897.143339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.143440:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299430400 00000100:00100000:0.0:1783137897.143452:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299430400 00000100:00100000:0.0:1783137897.143518:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783137897.143528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:10305:x1869755299430400:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137897.146436:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+33:10305:x1869755299430400:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 2893us (3102us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783137897.146453:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1783137897.418757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137897.420123:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299430656 00000100:00100000:1.0:1783137897.420137:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299430656 00000100:00100000:1.0:1783137897.420291:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1783137897.420303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+33:10336:x1869755299430656:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:1.0:1783137897.420328:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137897.420349:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b73e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922622 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.420800:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b73ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.420816:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b73ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.420828:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b73ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137897.420841:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783137897.421124:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b73e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922622 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.421146:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b73ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922622 expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.421155:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137897.421158:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137897.421161:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6ca00, rc 0) 00000100:00100000:1.0:1783137897.421365:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:10336:x1869755299430656:12345-192.168.202.24@tcp:101:cat.0 Request processed in 1063us (2619us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1783137897.421382:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:3.0:1783137897.428415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137897.428588:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299430912 00000100:00100000:1.0:1783137897.428600:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299430912 00000100:00100000:1.0:1783137897.428938:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1783137897.428948:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:10336:x1869755299430912:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:1.0:1783137897.429212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:10336:x1869755299430912:12345-192.168.202.24@tcp:35:cat.0 Request processed in 264us (806us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1783137897.429227:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1783137897.433068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.433131:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431040 00000100:00100000:3.0:1783137897.433141:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431040 00000100:00100000:3.0:1783137897.433212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1783137897.433222:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+36:2351:x1869755299431040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137897.433238:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137897.433263:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b73ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922622 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.433297:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:3.0:1783137897.433302:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137897.433356:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+35:2351:x1869755299431040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 135us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.433380:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1783137897.530668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137897.531800:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431296 00000100:00100000:1.0:1783137897.531813:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431296 00000100:00100000:1.0:1783137897.531902:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1783137897.531912:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+35:10342:x1869755299431296:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1783137897.531939:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137897.531943:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783137897.531974:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225f8 expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.531996:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137897.532001:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137897.532015:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b73fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922629 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.532119:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.532133:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.532141:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.532188:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.532203:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 35 pid: 5811 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137897.532232:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322534656:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137897.532339:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137897.541221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.544002:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431424 00000100:00100000:3.0:1783137897.544018:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431424 00010000:00010000:3.0:1783137897.544075:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 36 pid: 5811 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137897.544136:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1783137897.544156:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:2353:x1869755299431424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137897.544172:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137897.544178:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 36 pid: 5811 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.544427:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 36 pid: 5811 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.544456:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:3.0:1783137897.544463:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.544474:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.544481:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.544502:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137897.544621:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:2353:x1869755299431424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 466us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.544630:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00010000:00010000:1.0:1783137897.548438:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b73d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392261b expref: 35 pid: 5811 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137897.548470:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322534656:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137897.548500:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.549167:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.549174:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137897.549328:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783137897.550641:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b73fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.551080:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.551090:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137897.551094:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137897.551097:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c200, rc 0) 00000100:00100000:1.0:1783137897.551311:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+35:10342:x1869755299431296:12345-192.168.202.24@tcp:101:dd.0 Request processed in 19399us (20651us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783137897.551340:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:2.0:1783137897.561846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.571398:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431680 00000100:00100000:0.0:1783137897.571414:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431680 00000100:00100000:0.0:1783137897.571486:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:0.0:1783137897.571496:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+35:10342:x1869755299431680:12345-192.168.202.24@tcp:36:dd.0 00000100:00100000:3.0:1783137897.572061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.572098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.572125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.572165:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431808 00000100:00100000:3.0:1783137897.572171:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431808 00000100:00100000:3.0:1783137897.572213:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 292 00000100:00100000:3.0:1783137897.572222:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299431808:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137897.572309:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299431808:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.572317:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 292 00000100:00100000:3.0:1783137897.572354:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299431936 00000100:00100000:3.0:1783137897.572357:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299431936 00000100:00100000:3.0:1783137897.572397:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1783137897.572404:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299431936:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137897.572433:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299431936:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.572440:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1783137897.572458:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432064 00000100:00100000:3.0:1783137897.572462:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432064 00000100:00080000:3.0:1783137897.572486:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137897.572509:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:3.0:1783137897.572515:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299432064:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137897.572821:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299432064:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.572831:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00010000:00010000:0.0:1783137897.574179:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.574397:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137897.574410:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137897.574484:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783137897.574522:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0f20bf4 reply state 000000008067bbae transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137897.574532:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137897.575197:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+38:10342:x1869755299431680:12345-192.168.202.24@tcp:36:dd.0 Request processed in 3688us (13347us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783137897.575206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000020:00080000:0.0:1783137897.575212:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783137897.585087:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585127:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585136:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585729:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137897.585737:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585748:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585767:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:3.0:1783137897.585769:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137897.585774:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.585779:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7411 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137897.916343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.927670:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432192 00000100:00100000:3.0:1783137897.927689:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432192 00000100:00100000:3.0:1783137897.927771:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1783137897.927783:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+37:10356:x1869755299432192:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:3.0:1783137897.927810:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137897.927833:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7418 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922630 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929127:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929167:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929181:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929202:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929209:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929216:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929348:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929381:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.929391:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.935158:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137897.935183:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 38 pid: 5813 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137897.935202:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322534784:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137897.935401:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137897.946092:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322534784:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137897.946121:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137897.948185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137897.948304:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432448 00000100:00100000:0.0:1783137897.948314:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432448 00000100:00100000:0.0:1783137897.948386:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783137897.948398:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:5580:x1869755299432448:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783137897.948851:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+40:5580:x1869755299432448:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 455us (674us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1783137897.948861:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1783137897.956171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137897.956305:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432576 00000100:00100000:3.0:1783137897.956316:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432576 00010000:00010000:3.0:1783137897.956741:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 40 pid: 5813 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137897.956849:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137897.956862:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+40:2352:x1869755299432576:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137897.956906:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137897.956915:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 40 pid: 5813 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.956930:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 40 pid: 5813 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.956953:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7403 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922629 expref: 40 pid: 5813 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.956972:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:3.0:1783137897.956978:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.956988:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.956995:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137897.958196:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137897.958284:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:2352:x1869755299432576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1408us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137897.958295:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00010000:00010000:1.0:1783137897.958740:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958751:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137897.958798:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783137897.958802:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137897.958842:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958857:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958867:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958874:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958880:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958886:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137897.958901:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958908:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958921:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137897.958935:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137897.958939:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958946:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b741f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958962:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958969:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958976:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958981:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137897.958984:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958990:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.958999:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2200) 00010000:00010000:1.0:1783137897.959001:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137897.959004:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.959022:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.959064:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922630 expref: 39 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.959089:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922630 expref: 38 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137897.959097:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137897.959099:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137897.959102:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6800, rc 0) 00000100:00100000:1.0:1783137897.959135:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+38:10356:x1869755299432192:12345-192.168.202.24@tcp:101:stat.0 Request processed in 31354us (42804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137897.959142:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00010000:00010000:3.0:1783137897.978746:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137898.087846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137898.088526:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432832 00000100:00100000:1.0:1783137898.088580:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432832 00000100:00080000:3.0:1783137898.088680:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137898.088692:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:1.0:1783137898.088708:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+38:10362:x1869755299432832:12345-192.168.202.24@tcp:36:truncate.0 00010000:00010000:1.0:1783137898.088780:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137898.088811:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b742d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922630 expref: 38 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.088835:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137898.088841:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137898.089077:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.089092:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.089103:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137898.089166:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1783137898.089188:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e1251ec reply state 000000008d31c5e3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137898.089196:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137898.089322:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+40:10362:x1869755299432832:12345-192.168.202.24@tcp:36:truncate.0 Request processed in 618us (1491us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783137898.089329:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000020:00080000:1.0:1783137898.089335:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783137898.096752:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.096779:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.096789:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.096796:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137898.096803:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.096812:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.096835:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137898.096839:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137898.096845:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.097413:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7434 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137898.170883:0:6762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388063334020ns, next at 389063329662ns, rc = 0 00000100:00100000:1.0:1783137898.171038:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137898.171071:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322534912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137898.171174:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137898.171352:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322534912 00000100:00100000:3.0:1783137898.171391:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322534912 00000100:00100000:3.0:1783137898.171479:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783137898.171491:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322534912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137898.171596:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137898.171833:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322534912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 334us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137898.171851:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1783137898.171868:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137898.173040:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322534912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137898.294997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.295151:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299432960 00000100:00100000:0.0:1783137898.295168:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299432960 00000100:00100000:0.0:1783137898.295249:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:0.0:1783137898.295294:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:10376:x1869755299432960:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:0.0:1783137898.295331:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137898.295359:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b743b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922637 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295479:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295497:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295513:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295531:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295539:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295596:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295726:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295735:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295743:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137898.295792:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783137898.295798:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137898.295827:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295851:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295861:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295868:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295875:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295882:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.295887:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295896:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295911:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137898.295915:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.295921:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295928:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b7442 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295947:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295953:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295966:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295971:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.295975:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295981:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295988:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137898.295991:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.295993:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.295999:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.296039:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b743b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.296056:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.296065:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.296067:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137898.296070:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137898.296173:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+40:10376:x1869755299432960:12345-192.168.202.24@tcp:101:stat.0 Request processed in 912us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137898.296193:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:0.0:1783137898.397229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137898.397505:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299433216 00000100:00100000:1.0:1783137898.397521:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299433216 00000100:00100000:1.0:1783137898.398328:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1783137898.398349:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+40:10386:x1869755299433216:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137898.398495:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137898.398523:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392263e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137898.399047:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783137898.399232:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7457 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392263e expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.399251:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:1.0:1783137898.399254:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137898.399260:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392263e expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.399288:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6cc00, rc 0) 00000100:00100000:1.0:1783137898.399521:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+41:10386:x1869755299433216:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1178us (2306us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1783137898.399532:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:3.0:1783137898.406820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.407137:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299433472 00000100:00100000:0.0:1783137898.407152:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299433472 00000100:00100000:0.0:1783137898.407224:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:0.0:1783137898.407236:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+41:10386:x1869755299433472:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137898.412145:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+42:10386:x1869755299433472:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 4889us (5322us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783137898.412169:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1783137898.507514:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.509794:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299433728 00000100:00100000:0.0:1783137898.509815:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299433728 00000100:00100000:0.0:1783137898.509943:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:0.0:1783137898.509958:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+42:10391:x1869755299433728:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137898.509995:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137898.510025:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7465 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922645 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.510178:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.510196:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.510205:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.510247:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.510296:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 43 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.510313:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322535040:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137898.510457:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137898.530217:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322535040:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137898.530260:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137898.531299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.531798:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299433856 00000100:00100000:0.0:1783137898.531810:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299433856 00010000:00010000:0.0:1783137898.531875:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 44 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.531925:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:0.0:1783137898.531938:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+44:2352:x1869755299433856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137898.531958:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137898.531966:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 44 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.531980:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 44 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.532008:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922637 expref: 44 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.532051:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.532056:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.532067:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.532075:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.532116:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137898.532194:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+43:2352:x1869755299433856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 257us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137898.532203:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00010000:00010000:1.0:1783137898.534478:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.534500:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137898.534530:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783137898.534817:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7465 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.534859:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.534870:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137898.534873:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137898.534876:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030c00, rc 0) 00000100:00100000:1.0:1783137898.534966:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+43:10391:x1869755299433728:12345-192.168.202.24@tcp:101:bash.0 Request processed in 25011us (27466us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783137898.534975:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1783137898.542458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137898.542712:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299434112 00000100:00100000:2.0:1783137898.542727:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299434112 00000100:00100000:2.0:1783137898.542808:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:2.0:1783137898.542822:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+43:10391:x1869755299434112:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:2.0:1783137898.543222:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.543244:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.543260:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137898.543331:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1783137898.543359:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000839885c8 reply state 00000000e5e46163 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137898.543400:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137898.543533:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+46:10391:x1869755299434112:12345-192.168.202.24@tcp:36:bash.0 Request processed in 713us (1092us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1783137898.543541:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00010000:00010000:0.0:1783137898.549000:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549026:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549034:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549041:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.549048:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549058:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549106:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.549110:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.549116:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.549123:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b747a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783137898.549345:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783137898.550045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137898.550972:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299434240 00000100:00100000:2.0:1783137898.550988:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299434240 00000100:00100000:2.0:1783137898.551060:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:2.0:1783137898.551073:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+45:10391:x1869755299434240:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137898.551108:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137898.551138:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392264c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.551288:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.551306:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.551317:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.551373:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.551389:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 46 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137898.551419:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322535168:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137898.551528:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dffe32480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137898.558004:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322535168:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137898.558052:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.564209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137898.565094:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299434368 00000100:00100000:2.0:1783137898.565112:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299434368 00010000:00010000:2.0:1783137898.565176:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 47 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137898.565234:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1783137898.565246:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+47:2352:x1869755299434368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137898.565277:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137898.565287:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 47 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565303:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 47 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565334:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b746c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922645 expref: 47 pid: 5811 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565359:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:2.0:1783137898.565439:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565469:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565479:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.565653:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137898.565730:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+46:2352:x1869755299434368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 486us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137898.565741:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00010000:00010000:1.0:1783137898.573260:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.573291:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137898.573489:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783137898.573495:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137898.573600:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.573664:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392264c expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.573695:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392264c expref: 45 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.573706:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:1.0:1783137898.573709:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137898.573713:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685400, rc 0) 00000100:00100000:1.0:1783137898.573888:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+45:10391:x1869755299434240:12345-192.168.202.24@tcp:101:bash.0 Request processed in 22817us (23851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137898.573898:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1783137898.581305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137898.587516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299434624 00000100:00100000:1.0:1783137898.587538:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299434624 00000100:00100000:2.0:1783137898.592447:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:2.0:1783137898.592476:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc60e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+45:10391:x1869755299434624:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1783137898.593196:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc60e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:10391:x1869755299434624:12345-192.168.202.24@tcp:35:bash.0 Request processed in 727us (11902us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1783137898.593206:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783137898.668239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137898.668381:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299434880 00000100:00100000:1.0:1783137898.668398:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299434880 00000100:00100000:1.0:1783137898.668491:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:1.0:1783137898.668505:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:10402:x1869755299434880:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137898.668541:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137898.668623:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b748f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922653 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137898.668795:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783137898.668979:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b748f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922653 expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.669022:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:1.0:1783137898.669026:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137898.669033:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b748f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922653 expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137898.669054:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6cc00, rc 0) 00000100:00100000:1.0:1783137898.669164:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+47:10402:x1869755299434880:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 662us (940us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1783137898.669173:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:3.0:1783137898.671965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.672278:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299435008 00000100:00100000:0.0:1783137898.672291:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299435008 00000100:00100000:0.0:1783137898.672366:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:0.0:1783137898.672379:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+47:10402:x1869755299435008:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:0.0:1783137898.672482:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672503:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672516:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672534:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672542:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672592:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.672992:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673003:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673010:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137898.673066:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673084:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673091:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673098:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673105:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.673110:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673119:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673133:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137898.673137:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.673143:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673157:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b749d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673175:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673181:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673187:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673192:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.673195:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673201:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673208:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137898.673211:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.673213:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673219:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673237:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673243:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673255:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673272:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.673275:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673282:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673290:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.673293:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.673295:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.673302:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.673415:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+47:10402:x1869755299435008:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1037us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137898.673425:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1783137898.675328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.676035:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299435264 00000100:00100000:0.0:1783137898.676050:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299435264 00000100:00100000:0.0:1783137898.676215:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783137898.676229:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+47:10402:x1869755299435264:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137898.676646:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+48:10402:x1869755299435264:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 419us (1330us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783137898.676655:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1783137898.731212:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.731677:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299435520 00000100:00100000:0.0:1783137898.731692:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299435520 00000100:00100000:0.0:1783137898.731781:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1783137898.731793:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+48:10405:x1869755299435520:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137898.731828:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137898.731868:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392265a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.731975:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.731993:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732008:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732026:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732034:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732040:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732219:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732230:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732276:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137898.732291:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783137898.732463:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732472:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732479:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732485:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.732490:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732498:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732513:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137898.732516:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.732523:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732530:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b74b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732622:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732630:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732642:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732648:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137898.732651:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732657:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732665:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137898.732668:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137898.732671:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732677:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b74c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732730:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392265a expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732747:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392265a expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.732755:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.732757:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137898.732767:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031000, rc 0) 00000100:00100000:0.0:1783137898.732859:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+50:10405:x1869755299435520:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1068us (1663us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1783137898.732877:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:1.0:1783137898.748582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137898.748646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137898.748732:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299435648 00000100:00100000:2.0:1783137898.748745:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299435648 00000100:00100000:2.0:1783137898.748822:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:2.0:1783137898.748834:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+50:10405:x1869755299435648:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1783137898.748947:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.748969:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.748984:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.749025:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299435776 00000100:00100000:0.0:1783137898.749031:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299435776 00000100:00100000:0.0:1783137898.749074:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1783137898.749082:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+51:2352:x1869755299435776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137898.749095:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137898.749120:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392265a expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.749143:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.749148:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137898.749178:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.749185:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.749192:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.749198:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137898.749203:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.749211:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137898.749216:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+50:2352:x1869755299435776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 136us (570us total) trans 0 rc 0/0 00010000:00010000:2.0:1783137898.749220:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:2.0:1783137898.749223:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1783137898.749224:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00010000:00010000:2.0:1783137898.749226:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137898.749232:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137898.749359:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+49:10405:x1869755299435648:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 527us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137898.749366:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:2.0:1783137898.753074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.753171:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299436032 00000100:00100000:0.0:1783137898.753184:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299436032 00000100:00100000:0.0:1783137898.753256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1783137898.753298:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+49:10405:x1869755299436032:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137898.753695:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+50:10405:x1869755299436032:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 398us (636us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783137898.753704:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1783137898.957701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137898.958069:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299436288 00000100:00100000:0.0:1783137898.958097:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299436288 00000100:00100000:0.0:1783137898.958181:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1783137898.958194:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+50:10423:x1869755299436288:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1783137898.958248:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137898.958310:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922661 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.958774:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.958795:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.958808:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137898.958823:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783137898.959007:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b74dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922661 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.959034:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922661 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137898.959044:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:0.0:1783137898.959047:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783137898.959051:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030c00, rc 0) 00000100:00100000:0.0:1783137898.961113:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:10423:x1869755299436288:12345-192.168.202.24@tcp:101:cat.0 Request processed in 2904us (3411us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1783137898.961130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00010000:00010000:2.0:1783137899.002860:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137899.003738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.012232:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299436416 00000100:00100000:2.0:1783137899.012293:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299436416 00000100:00100000:2.0:1783137899.012411:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1783137899.012425:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+52:10424:x1869755299436416:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137899.012471:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137899.012518:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922668 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012653:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012672:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012685:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137899.012771:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783137899.012776:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137899.012802:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012835:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b74f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922668 expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012862:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922668 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.012872:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137899.012875:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137899.012879:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684200, rc 0) 00000100:00100000:2.0:1783137899.012985:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:10424:x1869755299436416:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 562us (9256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137899.012994:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1783137899.031383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137899.031535:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299436800 00000100:00100000:0.0:1783137899.031593:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299436800 00000100:00100000:0.0:1783137899.031682:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783137899.031719:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:10424:x1869755299436800:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137899.032384:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+54:10424:x1869755299436800:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 666us (1019us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1783137899.032394:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1783137899.040729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.040806:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299436928 00000100:00100000:2.0:1783137899.040820:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299436928 00000100:00100000:2.0:1783137899.040924:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:2.0:1783137899.040938:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+54:10424:x1869755299436928:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:2.0:1783137899.040958:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783137899.040993:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392264c expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.041026:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b74e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922661 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.041041:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392260d expref: 52 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.041052:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dcc9ec000) 00010000:00010000:2.0:1783137899.041066:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137899.041143:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+51:10424:x1869755299436928:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 208us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137899.041151:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:1.0:1783137899.046604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137899.046834:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437056 00000100:00100000:3.0:1783137899.046850:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437056 00000100:00100000:3.0:1783137899.046937:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:3.0:1783137899.046952:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+51:10424:x1869755299437056:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:3.0:1783137899.047145:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.047166:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.047181:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137899.052892:0:7189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137899.053212:0:7189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1783137899.053339:0:7189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1783137899.054037:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+51:10424:x1869755299437056:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 7075us (7435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137899.054053:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1783137899.096799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137899.097291:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437184 00000100:00100000:1.0:1783137899.097306:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437184 00000100:00100000:1.0:1783137899.097396:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:1.0:1783137899.097411:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+51:10426:x1869755299437184:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137899.097442:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137899.097473:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b7506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392266f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097632:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097675:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097689:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097707:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097715:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.097721:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098048:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098057:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098064:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137899.098107:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783137899.098111:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137899.098132:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098144:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098164:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098171:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098178:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098185:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137899.098190:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098198:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098212:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137899.098215:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137899.098220:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098227:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b750d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098245:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098252:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098274:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098287:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137899.098290:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098297:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098306:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc5113600) 00010000:00010000:1.0:1783137899.098308:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137899.098311:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098317:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098357:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b7506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098372:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.098380:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:1.0:1783137899.098382:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137899.098385:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c600, rc 0) 00000100:00100000:1.0:1783137899.098492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:10426:x1869755299437184:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1084us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137899.098502:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000040:00080000:3.0:1783137899.835000:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137899.835033:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137899.835100:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783137899.835108:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137899.835285:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322535296:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137899.835446:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137899.843243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137899.843382:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437312 00000100:00100000:1.0:1783137899.843404:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437312 00000100:00100000:1.0:1783137899.843483:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1783137899.843495:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299437312:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783137899.843643:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299437312:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 Request processed in 150us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137899.843651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1783137899.851777:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322535296:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137899.853001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137899.853110:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437440 00000100:00100000:0.0:1783137899.853122:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437440 00000100:00100000:0.0:1783137899.853202:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:0.0:1783137899.853215:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:10437:x1869755299437440:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783137899.853274:0:5812:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783137899.853621:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:10437:x1869755299437440:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 408us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137899.853631:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:1.0:1783137899.863756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.866147:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437568 00000100:00100000:2.0:1783137899.866169:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437568 00000100:00100000:2.0:1783137899.866281:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1783137899.866295:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:10437:x1869755299437568:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783137899.866579:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.866602:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.866625:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.869950:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.869977:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.869991:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870031:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870041:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870047:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137899.870095:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783137899.870100:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137899.870113:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870125:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870145:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870152:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870159:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137899.870164:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870171:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870185:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:2.0:1783137899.870188:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137899.870193:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870199:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7522 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870217:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870223:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870229:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870233:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137899.870241:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870248:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870269:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137899.870272:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137899.870275:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870280:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7529 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870299:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870305:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870311:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870315:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137899.870318:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870323:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870329:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:2.0:1783137899.870331:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137899.870341:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.870347:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137899.870797:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:10437:x1869755299437568:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 4344us (6899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137899.870809:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1783137899.879300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137899.879399:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437824 00000100:00100000:3.0:1783137899.879410:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437824 00000100:00100000:3.0:1783137899.879479:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:3.0:1783137899.879491:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+52:10437:x1869755299437824:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137899.879515:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137899.879541:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7537 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922676 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879694:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879709:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879721:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137899.879732:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783137899.879843:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879850:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879875:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879881:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137899.879886:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879894:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879906:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137899.879909:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137899.879914:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879920:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b753e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879965:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7537 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922676 expref: 54 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879975:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137899.879978:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137899.879981:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7537 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922676 expref: 54 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.879991:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783137899.880048:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299437824:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 559us (760us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1783137899.880063:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:1.0:1783137899.897026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.898509:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299437952 00000100:00100000:2.0:1783137899.898523:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299437952 00000100:00100000:2.0:1783137899.898628:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:2.0:1783137899.898639:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299437952:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137899.898688:0:5813:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137899.898805:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299437952:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 167us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137899.898821:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:1.0:1783137899.916858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.917115:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299438208 00000100:00100000:2.0:1783137899.917125:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299438208 00000100:00100000:2.0:1783137899.917187:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:2.0:1783137899.917198:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299438208:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137899.917217:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137899.917220:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137899.917248:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b74f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922668 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.917280:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137899.917292:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137899.917306:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b754c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392267d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137899.918405:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783137899.921192:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.921217:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.921229:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.921319:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b754c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392267d expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.921341:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392267d expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.921351:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137899.921354:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137899.921358:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685800, rc 0) 00000100:00100000:2.0:1783137899.921445:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+54:10437:x1869755299438208:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 4249us (4596us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783137899.921455:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:1.0:1783137899.926228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.926380:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299438464 00000100:00100000:2.0:1783137899.926392:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299438464 00000100:00100000:2.0:1783137899.926458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:2.0:1783137899.926470:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:10437:x1869755299438464:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137899.926602:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137899.926951:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392267d expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.926973:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137899.926986:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137899.927014:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927027:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927038:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927091:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927100:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927107:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927201:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927210:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927216:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927232:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137899.927237:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927245:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927266:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137899.927269:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137899.927274:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927280:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7561 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927291:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927296:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927301:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927307:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137899.927309:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927316:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927336:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa01f380c (ffff8e5de2d1c400) 00010000:00010000:2.0:1783137899.927338:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137899.927341:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.927347:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7568 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa01f380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137899.927441:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299438464:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 972us (1226us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137899.927450:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:0.0:1783137899.948124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137899.948928:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299438592 00000100:00100000:3.0:1783137899.948941:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299438592 00000100:00100000:3.0:1783137899.949010:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:3.0:1783137899.949022:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+53:10437:x1869755299438592:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137899.949046:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137899.949071:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b756f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922684 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949110:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949125:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949136:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949234:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b756f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 55 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949262:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 54 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.949271:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:3.0:1783137899.949274:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783137899.949277:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6e00, rc 0) 00000100:00100000:3.0:1783137899.949352:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:10437:x1869755299438592:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 332us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137899.949366:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:3.0:1783137899.954307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137899.954698:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299438848 00000100:00100000:2.0:1783137899.954851:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299438848 00000100:00100000:2.0:1783137899.954975:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 75 00000100:00100000:2.0:1783137899.954986:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:10437:x1869755299438848:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137899.955302:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.955322:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137899.955336:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137899.956194:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783137899.956213:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389848666875ns, next at 390848663170ns, rc = 0 00000004:00010000:2.0:1783137899.956330:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee105452 reply state 00000000f5cd436a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137899.956354:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137899.956721:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+56:10437:x1869755299438848:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1475us (2162us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1783137899.956732:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 75 00010000:00010000:1.0:1783137899.968808:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.968834:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.968843:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.968849:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137899.968854:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.968867:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.969174:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:1.0:1783137899.969178:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783137899.969192:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137899.969199:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b757d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137899.973561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137899.973602:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299438976 00000100:00100000:3.0:1783137899.973614:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299438976 00000100:00100000:3.0:1783137899.973670:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:3.0:1783137899.973681:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:10437:x1869755299438976:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137899.973710:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137899.973734:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392268b expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.977112:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.977139:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137899.977166:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:3.0:1783137899.977170:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137899.977174:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783137899.977262:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+56:10437:x1869755299438976:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 3570us (3716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137899.977274:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:1.0:1783137899.984223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137899.987019:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299439104 00000100:00100000:3.0:1783137899.987034:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299439104 00000100:00100000:3.0:1783137899.987091:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1783137899.987099:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869755299439104:12345-192.168.202.24@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783137899.987136:0:6615:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:3.0:1783137899.987167:0:6615:0:(genops.c:1406:class_connect()) connect: client 75742c0b-74ec-412f-af86-0dbffc92280b, cookie 0x4691dfc3d66b758b 00002000:00100000:3.0:1783137899.987180:0:6615:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75742c0b-74ec-412f-af86-0dbffc92280b/ffff8e5dffbc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137899.987210:0:6615:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137899.987481:0:6615:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137899.987524:0:6615:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137899.987635:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2349:x1869755299439104:12345-192.168.202.24@tcp:8:lhsmtool_posix.0 Request processed in 535us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137899.987643:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:1.0:1783137900.021566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137900.021765:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299439232 00000100:00100000:2.0:1783137900.021836:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299439232 00000100:00100000:2.0:1783137900.021942:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1783137900.021953:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:0:x1869755299439232:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783137900.022330:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783137900.028867:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137900.118200:0:11884:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137900.118211:0:11884:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137900.118609:0:11884:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783137900.118615:0:11884:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137900.149437:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:0:x1869755299439232:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 127472us (128091us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783137900.149453:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000001:00080000:2.0:1783137900.149494:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1783137900.149505:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000100:00100000:0.0:1783137900.159815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.159861:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299439488 00000100:00100000:0.0:1783137900.159871:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299439488 00000100:00100000:0.0:1783137900.159944:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1783137900.159956:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+56:10437:x1869755299439488:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137900.160213:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+57:10437:x1869755299439488:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 259us (411us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783137900.160221:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00080000:0.0:1783137900.160244:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137900.169005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.170320:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299439744 00000100:00100000:0.0:1783137900.170401:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299439744 00000100:00100000:2.0:1783137900.174701:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:2.0:1783137900.174717:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+57:10437:x1869755299439744:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783137900.175129:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+57:10437:x1869755299439744:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 414us (6134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137900.175138:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:0.0:1783137900.181399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137900.182179:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299439872 00000100:00100000:3.0:1783137900.182194:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299439872 00000100:00100000:3.0:1783137900.182373:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:3.0:1783137900.182386:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+57:10437:x1869755299439872:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137900.182413:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137900.182439:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922692 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182537:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182580:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182594:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137900.182656:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137900.182675:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182702:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922692 expref: 59 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182721:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922692 expref: 58 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.182729:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:3.0:1783137900.182733:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783137900.182736:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6600, rc 0) 00000100:00100000:3.0:1783137900.182800:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+58:10437:x1869755299439872:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 417us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137900.182809:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:0.0:1783137900.186993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137900.187190:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440000 00000100:00100000:3.0:1783137900.187200:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440000 00000100:00100000:3.0:1783137900.187268:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:3.0:1783137900.187278:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299440000:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137900.187297:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137900.187321:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922699 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137900.187349:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48866b, blocks: 0x1 00010000:00010000:3.0:1783137900.187368:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1783137900.187381:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137900.187391:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 6 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.187413:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 6 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.187426:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6c00, rc 0) 00000100:00100000:3.0:1783137900.187488:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299440000:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 211us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137900.187496:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:2.0:1783137900.195706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.195944:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440256 00000100:00100000:1.0:1783137900.195956:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440256 00000100:00100000:1.0:1783137900.196142:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:1.0:1783137900.196156:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+58:10437:x1869755299440256:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783137900.196299:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+58:10437:x1869755299440256:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 146us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.196307:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:0.0:1783137900.201713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.201848:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440384 00000100:00100000:1.0:1783137900.201859:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440384 00000100:00100000:1.0:1783137900.201935:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1783137900.201947:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:10437:x1869755299440384:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137900.201965:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137900.201987:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226a0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.202017:0:7801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 7 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.202026:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137900.202036:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137900.202043:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.202076:0:7801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 7 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.202090:0:7801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 7 pid: 6615 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.202104:0:7801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7801:1869755322535424:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137900.202197:0:7801:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137900.208614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137900.208969:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440512 00000100:00100000:3.0:1783137900.208978:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440512 00010000:00010000:3.0:1783137900.209021:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 8 pid: 6615 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137900.209069:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1783137900.209079:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299440512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137900.209094:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137900.209116:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 8 pid: 6615 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.209130:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 8 pid: 6615 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.209157:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137900.209173:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137900.209183:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.209195:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.209233:0:6630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137900.209247:0:6630:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6630:1869755322535552:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783137900.209337:0:6630:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa1819c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783137900.210029:0:7801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f41d7329/0x4691dfc3d66b75a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922699 expref: 8 pid: 6615 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.210047:0:7801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7801:1869755322535424:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137900.210086:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.210098:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d800, rc 0) 00000100:00100000:1.0:1783137900.210146:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:10437:x1869755299440384:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 8202us (8441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.210153:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1783137900.219410:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322535808:0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.219486:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137900.219573:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322535808 00000100:00100000:0.0:1783137900.219581:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322535808 00000100:00100000:0.0:1783137900.219640:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783137900.219651:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322535808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.219709:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322535808:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.219717:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783137900.219767:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322535808:0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.219806:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322535936:0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.219901:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137900.219931:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322535936 00000100:00100000:0.0:1783137900.219935:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322535936 00000100:00100000:0.0:1783137900.219967:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783137900.219973:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322535936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.220006:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322535936:12345-0@lo:400:kworker.0 Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.220013:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1783137900.220028:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137900.220047:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322535936:0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.220126:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322536320:0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.220153:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137900.220182:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322536320 00000100:00100000:0.0:1783137900.220186:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322536320 00000100:00100000:0.0:1783137900.220219:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783137900.220225:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322536320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.220273:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322536320:12345-0@lo:400:kworker.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.220279:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783137900.220296:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137900.220314:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322536320:0@lo:400:kworker.0 00000100:00100000:1.0:1783137900.220422:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322536064:0@lo:400:kworker.0 00000100:00100000:1.0:1783137900.220453:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137900.220486:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783137900.220493:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322535680:0@lo:400:kworker.0 00000100:00100000:1.0:1783137900.220519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137900.220560:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322536192:0@lo:400:kworker.0 00000100:00100000:1.0:1783137900.220589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137900.220651:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322536192 00000100:00100000:0.0:1783137900.220655:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322536192 00000100:00100000:0.0:1783137900.220693:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783137900.220699:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322536192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137900.220732:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322536192:12345-0@lo:400:kworker.0 Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.220738:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783137900.220758:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322536064 00000100:00100000:2.0:1783137900.220762:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322536064 00000100:00100000:0.0:1783137900.220764:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322536192:0@lo:400:kworker.0 00000100:00100000:2.0:1783137900.220920:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783137900.220928:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322536064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137900.220967:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322536064:12345-0@lo:400:kworker.0 Request processed in 40us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137900.220973:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783137900.220993:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322535680 00000100:00100000:2.0:1783137900.220996:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322535680 00000100:00100000:0.0:1783137900.221001:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322536064:0@lo:400:kworker.0 00000100:00100000:2.0:1783137900.221017:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1783137900.221023:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322535680:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783137900.221052:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137900.221056:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137900.221063:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3314:x1869755322535680:12345-0@lo:400:kworker.0 Request processed in 41us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137900.221069:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1783137900.221098:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322535680:0@lo:400:kworker.0 00000100:00100000:1.0:1783137900.233088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137900.233307:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440640 00000100:00100000:3.0:1783137900.233319:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440640 00002000:00100000:3.0:1783137900.233376:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e5dfb062a00 x1869755299440640/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:51/0 lens 504/0 e 0 to 0 dl 1783137911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137900.233396:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dfb062a00 with x1869755299440640 ext(0->8) 00002000:00010000:3.0:1783137900.233403:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5dfb062a00 00000100:00100000:3.0:1783137900.233443:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783137900.233454:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299440640:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783137900.234218:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:2353:x1869755299440640:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 761us (1139us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783137900.234228:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00002000:00100000:3.0:1783137900.234237:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e5dfb062a00 x1869755299440640/t4294967302(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:51/0 lens 504/448 e 0 to 0 dl 1783137911 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137900.234270:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dfb062a00 with x1869755299440640 ext(0->8) 00002000:00010000:3.0:1783137900.234274:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5dfb062a00 00000100:00100000:0.0:1783137900.236841:0:6630:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6630:1869755322535552:192.168.202.24@tcp:105: 00010000:00010000:0.0:1783137900.236872:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137900.236938:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299440512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 27859us (28334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.236955:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1783137900.247243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.247458:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440768 00000100:00100000:0.0:1783137900.247469:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440768 00000100:00100000:0.0:1783137900.247533:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:0.0:1783137900.247564:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+58:10437:x1869755299440768:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783137900.313962:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+58:10437:x1869755299440768:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 66410us (66716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137900.313974:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00000001:00080000:2.0:1783137900.314178:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1783137900.314216:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783137900.314242:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5de021dc00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783137900.314255:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd85cbc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5de021da80 00000020:00080000:2.0:1783137900.314259:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd85cb600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5df5ad0800 00000004:00080000:2.0:1783137900.314309:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1783137900.314337:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783137900.314388:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1783137900.314509:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783137900.315144:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322536448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783137900.315207:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137900.315326:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322536448 00000100:00100000:1.0:1783137900.315335:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322536448 00000100:00100000:1.0:1783137900.315403:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137900.315413:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322536448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783137900.315576:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783137900.315580:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783137899 00002000:00010000:1.0:1783137900.315582:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783137900.315585:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783137899 -> 1783137899 00002000:00010000:1.0:1783137900.315587:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783137900.315625:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322536448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (418us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783137900.315631:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1783137900.315668:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5dfb061880/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783137900.315673:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322536448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783137900.316158:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322536576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783137900.316198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137900.316237:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322536576 00000100:00100000:0.0:1783137900.316241:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322536576 00000100:00100000:0.0:1783137900.316281:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783137900.316288:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322536576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783137900.316304:0:6616:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1783137900.316330:0:6616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a488667, atime: 0x6a488667, ctime: 0x6a488667, blocks: 0x1 00010000:00010000:0.0:1783137900.316340:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.316357:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1783137900.316361:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137900.316367:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.316384:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.316408:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.316417:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.316433:0:6616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137900.318311:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322536576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2014us (2103us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783137900.318322:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1783137900.318500:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137900.318507:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.318519:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137900.318523:0:7510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.318534:0:7510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.318573:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.318581:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b75ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.318615:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137900.318617:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137900.318618:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783137900.319164:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5dd8033480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1783137900.319174:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322536576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783137900.319595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.319659:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299440896 00000100:00100000:1.0:1783137900.319665:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299440896 00000100:00100000:1.0:1783137900.319726:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:1.0:1783137900.319735:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299440896:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783137900.351470:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299440896:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 31724us (31865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.351482:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000001:00080000:3.0:1783137900.351608:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1783137900.351620:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1783137900.354504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.354679:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441152 00000100:00100000:0.0:1783137900.354689:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441152 00000100:00100000:0.0:1783137900.354792:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:0.0:1783137900.354802:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+13:10437:x1869755299441152:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137900.354874:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137900.354901:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922692 expref: 13 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.354922:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:0.0:1783137900.354926:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137900.354955:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.354968:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.354976:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137900.355209:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fe16b2f reply state 000000006ccc22fd transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137900.355218:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137900.355320:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:10437:x1869755299441152:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 519us (826us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783137900.356020:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00010000:00010000:0.0:1783137900.357875:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357892:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357899:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357905:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137900.357910:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357919:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357935:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:0.0:1783137900.357938:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137900.357943:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.357950:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b75b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137900.361754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137900.362068:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441280 00000100:00100000:2.0:1783137900.362078:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441280 00000100:00100000:2.0:1783137900.362135:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1783137900.362145:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299441280:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783137900.362406:0:7801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783137900.362410:0:7801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783137899 -> 1783137897 00002000:00010000:2.0:1783137900.362412:0:7801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783137895 00002000:00010000:2.0:1783137900.362414:0:7801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783137899 -> 1783137897 00002000:00010000:2.0:1783137900.362416:0:7801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783137900.362481:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299441280:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 336us (736us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783137900.362489:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1783137900.365312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.365493:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441536 00000100:00100000:1.0:1783137900.365502:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441536 00000100:00100000:1.0:1783137900.365601:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:1.0:1783137900.365613:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+13:10437:x1869755299441536:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783137900.365687:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.365703:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 13 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.365710:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.365738:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 13 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.365747:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 13 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.365757:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322536704:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137900.365957:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137900.368817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137900.368911:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441664 00000100:00100000:2.0:1783137900.368920:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441664 00010000:00010000:2.0:1783137900.368963:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137900.369003:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:1.0:1783137900.369006:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322536704:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137900.369011:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+14:2353:x1869755299441664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137900.369026:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137900.369031:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.369042:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.375010:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.375464:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922684 expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.375489:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:2.0:1783137900.375494:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.375505:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.375513:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.375661:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137900.375745:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+13:2353:x1869755299441664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6733us (6947us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137900.375756:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00010000:00010000:1.0:1783137900.377657:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377674:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377707:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377713:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377720:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377726:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137900.377730:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377737:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377752:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:1.0:1783137900.377755:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783137900.377759:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.377764:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b75bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.377967:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+12:10437:x1869755299441536:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 12354us (12660us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783137900.377978:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1783137900.382402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.382469:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441792 00000100:00100000:1.0:1783137900.382479:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441792 00000100:00100000:1.0:1783137900.382542:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:1.0:1783137900.382568:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2350:x1869755299441792:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783137900.382610:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.382631:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.382641:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137900.382645:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137900.382649:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.382680:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.382693:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 7 pid: 7801 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.382707:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322536832:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137900.383067:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137900.386508:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322536832:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137900.386573:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137900.399731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137900.399855:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299441920 00000100:00100000:1.0:1783137900.399866:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299441920 00010000:00010000:1.0:1783137900.399921:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.399967:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1783137900.399979:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299441920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137900.400000:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137900.400023:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400037:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400065:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b75a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a0 expref: 8 pid: 7801 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400093:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137900.400098:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137900.400104:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400137:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400172:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137900.400227:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299441920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 251us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.400235:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00010000:00010000:1.0:1783137900.400275:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400284:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400307:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400316:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400324:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400331:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137900.400337:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400366:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400378:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.400386:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b75c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.400434:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299441792:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 17868us (18041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.400443:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:1.0:1783137900.406229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137900.406329:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299442176 00000100:00100000:2.0:1783137900.406340:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299442176 00000100:00100000:2.0:1783137900.406412:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:2.0:1783137900.406421:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+12:10437:x1869755299442176:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783137900.406504:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406523:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406535:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406748:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406757:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 13 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406763:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406802:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 13 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.406820:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 13 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137900.406841:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322536960:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137900.406924:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137900.410030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137900.410116:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299442304 00000100:00100000:3.0:1783137900.410126:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299442304 00010000:00010000:3.0:1783137900.410169:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137900.410206:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322536960:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137900.410208:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1783137900.410217:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+14:2353:x1869755299442304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137900.410231:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.410233:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137900.410239:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.410261:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.410284:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392268b expref: 14 pid: 7189 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.413261:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:3.0:1783137900.413295:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.413309:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.413317:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.413483:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137900.414022:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+13:2353:x1869755299442304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3798us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137900.414034:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00010000:00010000:0.0:1783137900.414480:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.414491:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137900.414711:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1783137900.415493:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1783137900.415614:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1783137900.415716:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322537088:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783137900.415778:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137900.415905:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13f6000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137900.415994:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322537088 00000100:00100000:1.0:1783137900.416004:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322537088 00000100:00100000:1.0:1783137900.416162:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137900.416175:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322537088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783137900.416303:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322537088:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.416310:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137900.416441:0:5812:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783137900.416448:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5dfb061880, transno 4294967303 00000100:00100000:2.0:1783137900.416505:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01409c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322537088:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1783137900.416999:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783137900.417065:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322537216:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783137900.417260:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137900.417285:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137900.417448:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322537216 00000100:00100000:1.0:1783137900.417454:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322537216 00000100:00100000:1.0:1783137900.417493:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137900.417502:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322537216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783137900.417728:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1869755322537216:12345-0@lo:1000:mdt00_001.0 Request processed in 226us (478us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783137900.417741:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137900.418542:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322537216:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783137900.418606:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418616:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418624:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418630:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137900.418635:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418642:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418660:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5dc39a2700) 00010000:00010000:0.0:1783137900.418663:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137900.418667:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418672:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418710:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418714:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418718:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418721:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137900.418723:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418726:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418731:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:0.0:1783137900.418732:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137900.418734:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.418738:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b74ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.418792:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.418873:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.418885:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.418923:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.418940:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 16 pid: 5811 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.418953:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322537344:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137900.419029:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137900.423492:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322537344:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137900.423538:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137900.424391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.424524:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299442432 00000100:00100000:0.0:1783137900.424532:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299442432 00010000:00010000:0.0:1783137900.424607:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 17 pid: 5811 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137900.424703:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1783137900.424713:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+17:2352:x1869755299442432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137900.424746:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137900.424753:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 17 pid: 5811 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.424775:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 17 pid: 5811 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.424805:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b751b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392266f expref: 17 pid: 5811 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.424838:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:0.0:1783137900.424843:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.424854:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.424861:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137900.424977:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137900.425034:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+16:2352:x1869755299442432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 321us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.425043:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00010000:00010000:3.0:1783137900.425114:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425123:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425136:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425143:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425150:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425155:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137900.425160:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425168:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425178:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137900.425180:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137900.425190:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425196:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b75d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425208:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425215:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425220:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425226:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137900.425228:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425235:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425242:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137900.425245:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783137900.425259:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137900.425265:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685a00/0x4691dfc3d66b75ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137900.425480:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:10437:x1869755299442176:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 19059us (19259us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1783137900.425488:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00000020:00080000:3.0:1783137900.425498:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783137900.425644:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137900.425649:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137900.425676:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783137900.425682:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137900.432285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137900.432453:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299442688 00000100:00100000:0.0:1783137900.432464:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299442688 00000100:00100000:0.0:1783137900.432661:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1783137900.432673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:10437:x1869755299442688:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783137900.435417:0:5815:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783137900.435537:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1783137900.438022:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438045:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438056:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438064:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438071:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438077:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137900.438201:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783137900.438328:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+17:10437:x1869755299442688:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 5654us (6052us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783137900.438339:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000020:00080000:2.0:1783137900.438370:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783137900.442008:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137900.442024:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.442035:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137900.442056:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.442066:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.442094:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:0.0:1783137900.442098:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783137900.442103:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.442108:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b75df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137900.442136:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137900.442138:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137900.442140:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137900.731441:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322537472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137900.731519:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137900.731745:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322537472 00000100:00100000:1.0:1783137900.731754:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322537472 00000100:00100000:1.0:1783137900.731827:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783137900.731838:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322537472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137900.731863:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783137900.731921:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322537472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137900.731929:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137900.732024:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322537472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137901.053961:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783137902.044476:0:11936:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137902.044485:0:11936:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137902.044521:0:11936:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783137902.044527:0:11936:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783137902.075014:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137902.258890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.263625:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299442944 00000100:00100000:0.0:1783137902.263643:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299442944 00000100:00100000:0.0:1783137902.263723:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:0.0:1783137902.263737:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+17:10457:x1869755299442944:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137902.263769:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137902.263793:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b75e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226a7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.264072:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b75ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.264088:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b75ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.264109:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b75ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137902.264122:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:2.0:1783137902.264488:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137902.266350:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b75e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a7 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.266446:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b75ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a7 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.266456:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137902.266460:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137902.266463:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030200, rc 0) 00000100:00100000:1.0:1783137902.274201:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:10457:x1869755299442944:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 10450us (15304us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1783137902.274216:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:0.0:1783137902.280574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137902.280661:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299443072 00000100:00100000:3.0:1783137902.280671:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299443072 00000100:00100000:3.0:1783137902.280736:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:3.0:1783137902.280746:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:10457:x1869755299443072:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1783137902.280824:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.280841:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.280853:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.280867:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.280875:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.280882:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281219:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281228:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281248:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137902.281293:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281307:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281315:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281321:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281329:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.281334:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281341:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281354:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137902.281358:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.281363:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281377:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b75fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281393:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281399:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281405:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281409:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.281412:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281418:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281426:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137902.281429:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.281431:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281437:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281454:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281460:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281472:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281477:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.281480:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281486:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281494:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc39a2100) 00010000:00010000:3.0:1783137902.281497:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.281499:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.281505:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137902.281640:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:10457:x1869755299443072:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 893us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137902.281650:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00000001:00080000:0.0:1783137902.375361:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1783137902.375388:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1783137902.384270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.384422:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299443328 00000100:00100000:2.0:1783137902.384433:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299443328 00000100:00100000:2.0:1783137902.384522:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:2.0:1783137902.384534:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:10460:x1869755299443328:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137902.385529:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137902.385580:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385674:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385690:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385702:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385718:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385725:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.385732:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387157:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387174:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387190:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137902.387202:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783137902.387303:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387310:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387316:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.387322:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137902.387326:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388008:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388023:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137902.388026:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137902.388031:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388037:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388053:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388058:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388074:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388080:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137902.388083:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388089:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388097:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137902.388100:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137902.388102:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388108:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b761e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388163:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b7610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388178:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.388185:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137902.388187:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137902.388190:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684e00, rc 0) 00000100:00100000:2.0:1783137902.388310:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:10460:x1869755299443328:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 3778us (4051us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783137902.388338:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:3.0:1783137902.397416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.397618:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299443456 00000100:00100000:0.0:1783137902.397629:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299443456 00000100:00100000:0.0:1783137902.397708:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:0.0:1783137902.397717:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:10460:x1869755299443456:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:0.0:1783137902.397793:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397821:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397834:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397897:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397904:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397912:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397918:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137902.397922:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397929:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397941:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:0.0:1783137902.397944:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137902.397949:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.397955:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137902.398036:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:10460:x1869755299443456:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 319us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137902.398044:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:1.0:1783137902.404112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.404209:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299443712 00000100:00100000:2.0:1783137902.404221:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299443712 00000100:00100000:2.0:1783137902.404294:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1783137902.404304:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:10460:x1869755299443712:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137902.404594:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:10460:x1869755299443712:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 290us (491us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783137902.404601:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1783137902.472425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.472646:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299443968 00000100:00100000:2.0:1783137902.472656:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299443968 00000100:00100000:2.0:1783137902.472720:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:2.0:1783137902.472731:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+22:9978:x1869755299443968:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137902.472757:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137902.472778:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b763a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.472893:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.472910:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.472920:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.472953:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.472987:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 23 pid: 5811 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137902.473001:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322537600:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137902.473099:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137902.476043:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322537600:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137902.476075:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137902.485348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137902.485756:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444096 00000100:00100000:1.0:1783137902.485766:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444096 00010000:00010000:1.0:1783137902.485818:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 24 pid: 5811 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137902.485923:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1783137902.485935:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+24:2353:x1869755299444096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137902.485952:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137902.485974:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 24 pid: 5811 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.485988:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 24 pid: 5811 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.486011:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ae expref: 24 pid: 5811 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.486031:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:1.0:1783137902.486036:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.486045:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.486051:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.486083:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137902.486196:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+23:2353:x1869755299444096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 262us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137902.486205:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00010000:00010000:3.0:1783137902.486695:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.486705:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137902.486724:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783137902.486950:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b763a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.486978:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.486985:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:3.0:1783137902.486988:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783137902.486991:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684600, rc 0) 00000100:00100000:3.0:1783137902.487028:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+23:9978:x1869755299443968:12345-192.168.202.24@tcp:101:bash.0 Request processed in 14300us (14615us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783137902.487036:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1783137902.491614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.492146:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444352 00000100:00100000:0.0:1783137902.492157:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444352 00000100:00100000:0.0:1783137902.492216:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:0.0:1783137902.492253:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+23:9978:x1869755299444352:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:0.0:1783137902.493104:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.493123:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.493135:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137902.493192:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1783137902.493219:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb437c69 reply state 00000000121a13fb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137902.493228:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783137902.493285:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1783137902.493840:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:9978:x1869755299444352:12345-192.168.202.24@tcp:36:bash.0 Request processed in 1587us (2234us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1783137902.493962:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000020:00080000:0.0:1783137902.493971:0:7189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783137902.498279:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498297:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498305:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498329:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137902.498335:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498351:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498370:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:1.0:1783137902.498373:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137902.498384:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.498392:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b764f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137902.499308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137902.499388:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444480 00000100:00100000:1.0:1783137902.499399:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444480 00000100:00100000:1.0:1783137902.499458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:1.0:1783137902.499467:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:9978:x1869755299444480:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137902.499493:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137902.499522:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226bc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.499625:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7656 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226bc expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.499640:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7656 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226bc expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.499676:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:1.0:1783137902.499679:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137902.499682:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6de00, rc 0) 00000100:00100000:1.0:1783137902.499745:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:9978:x1869755299444480:12345-192.168.202.24@tcp:101:bash.0 Request processed in 279us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137902.499752:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:0.0:1783137902.505139:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.505282:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444608 00000100:00100000:2.0:1783137902.505292:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444608 00000100:00100000:2.0:1783137902.505371:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00080000:1.0:1783137902.505458:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137902.505480:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:9978:x1869755299444608:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137902.505499:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137902.505519:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226c3 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137902.505561:0:7801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a488669, atime: 0x6a488667, ctime: 0x6a488669, blocks: 0xb 00010000:00010000:2.0:1783137902.505581:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1783137902.505585:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137902.505593:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.505610:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.505636:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685a00, rc 0) 00000100:00100000:2.0:1783137902.505694:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:9978:x1869755299444608:12345-192.168.202.24@tcp:101:bash.0 Request processed in 314us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137902.505702:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1783137902.509758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137902.510140:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444736 00000100:00100000:1.0:1783137902.510151:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444736 00002000:00010000:1.0:1783137902.510192:0:6620:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1783137902.510197:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5e01409c00 with x1869755299444736 ext(0->18446744073709551615) 00002000:00010000:1.0:1783137902.510209:0:6620:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5e01409c00. 00000100:00100000:1.0:1783137902.510258:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1783137902.510269:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299444736:12345-192.168.202.24@tcp:10:bash.0 00002000:00010000:1.0:1783137902.510845:0:6620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783137902.510849:0:6620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783137897 -> 1783137901 00002000:00010000:1.0:1783137902.510955:0:6620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783137895 -> 1783137895 00002000:00010000:1.0:1783137902.510958:0:6620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783137897 -> 1783137901 00002000:00010000:1.0:1783137902.510960:0:6620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783137902.511062:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299444736:12345-192.168.202.24@tcp:10:bash.0 Request processed in 794us (1313us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783137902.511071:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00002000:00010000:1.0:1783137902.511075:0:6620:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1783137902.511078:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5e01409c00 with x1869755299444736 ext(0->18446744073709551615) 00002000:00010000:1.0:1783137902.511083:0:6620:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5e01409c00. 00000100:00100000:3.0:1783137902.652870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.653030:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444864 00000100:00100000:0.0:1783137902.653040:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444864 00000100:00100000:0.0:1783137902.653092:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:0.0:1783137902.653100:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+27:10474:x1869755299444864:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:0.0:1783137902.653170:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653187:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653213:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653224:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653241:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653249:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653969:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653981:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.653988:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137902.654033:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654045:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654051:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654059:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654076:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137902.654080:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654088:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654102:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137902.654105:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137902.654110:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654117:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654131:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654137:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654142:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654148:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137902.654150:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654156:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654173:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ecb00) 00010000:00010000:0.0:1783137902.654176:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137902.654178:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654184:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b766b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654201:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654207:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654213:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654219:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137902.654221:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654227:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654247:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:0.0:1783137902.654249:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137902.654252:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137902.654257:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7672 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137902.656040:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+27:10474:x1869755299444864:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 2922us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137902.656057:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:0.0:1783137902.692125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.692168:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.692208:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137902.693096:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299444992 00000100:00100000:3.0:1783137902.693111:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299444992 00000100:00100000:3.0:1783137902.693179:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 294 00000100:00100000:3.0:1783137902.693189:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299444992:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137902.693293:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299444992:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 105us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137902.693300:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 294 00000100:00100000:1.0:1783137902.693372:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299445248 00000100:00100000:1.0:1783137902.693387:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299445248 00000100:00100000:1.0:1783137902.693436:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00100000:1.0:1783137902.693444:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299445248:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:0.0:1783137902.693637:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137902.693828:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299445120 00000100:00100000:2.0:1783137902.693833:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299445120 00000100:00100000:2.0:1783137902.693886:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:2.0:1783137902.693895:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299445120:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137902.695000:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299445248:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1549us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137902.695012:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00080000:1.0:1783137902.695047:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137902.695119:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299445120:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 1224us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137902.695126:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:2.0:1783137902.708891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137902.708980:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299445504 00000100:00100000:3.0:1783137902.708991:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299445504 00000100:00100000:3.0:1783137902.709042:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:3.0:1783137902.709053:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:10477:x1869755299445504:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137902.709075:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137902.709097:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226ca expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709174:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709185:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709194:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709203:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709207:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709211:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709931:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b768e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709942:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b768e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.709950:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b768e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137902.709960:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783137902.710056:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710064:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710077:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710082:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.710086:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710094:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710105:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137902.710108:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.710112:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710118:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710130:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710135:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710140:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710144:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.710147:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710161:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710168:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137902.710170:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.710172:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710178:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710221:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ca expref: 30 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710249:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b768e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ca expref: 29 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.710257:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:3.0:1783137902.710259:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783137902.710262:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783137902.710322:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+29:10477:x1869755299445504:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1271us (1439us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1783137902.710330:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:0.0:1783137902.716922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137902.717014:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299445632 00000100:00100000:3.0:1783137902.717029:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299445632 00000100:00100000:3.0:1783137902.717090:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:3.0:1783137902.717101:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+29:10477:x1869755299445632:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1783137902.717199:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.717217:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.717226:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.717273:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.717287:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 29 pid: 5813 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137902.717302:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322537728:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137902.717409:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137902.724584:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322537728:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137902.724618:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137902.730804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.730987:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299445888 00000100:00100000:2.0:1783137902.731000:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299445888 00000100:00100000:2.0:1783137902.731095:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1783137902.731107:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+30:5580:x1869755299445888:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783137902.731535:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+31:5580:x1869755299445888:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 429us (741us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783137902.731584:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1783137902.740224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137902.740957:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299446016 00000100:00100000:2.0:1783137902.740968:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299446016 00010000:00010000:2.0:1783137902.741010:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 31 pid: 5813 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137902.741103:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:2.0:1783137902.741114:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+31:2353:x1869755299446016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137902.741133:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137902.741140:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 31 pid: 5813 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741154:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 31 pid: 5813 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741179:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b7641 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226b5 expref: 31 pid: 5813 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741199:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137902.741203:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741212:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741220:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.741264:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137902.741322:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+30:2353:x1869755299446016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 209us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137902.741354:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00010000:00010000:3.0:1783137902.741417:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741425:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741464:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741472:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741490:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741496:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.741499:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741507:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741516:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:3.0:1783137902.741519:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137902.741522:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.741528:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b769c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137902.741605:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+29:10477:x1869755299445632:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 24505us (24695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137902.741613:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:3.0:1783137902.746948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.747098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299446272 00000100:00100000:0.0:1783137902.747111:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299446272 00000100:00100000:0.0:1783137902.747188:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1783137902.747200:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:10477:x1869755299446272:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137902.747729:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+30:10477:x1869755299446272:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 530us (787us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783137902.747737:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1783137902.895719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137902.895821:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299446528 00000100:00100000:3.0:1783137902.895834:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299446528 00000100:00100000:3.0:1783137902.895904:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:3.0:1783137902.895914:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+30:10488:x1869755299446528:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:3.0:1783137902.895940:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137902.895961:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b76a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226d1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896051:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896065:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896075:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896088:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896094:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.896100:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.897674:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b76b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.897692:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.897703:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137902.897715:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1783137902.897998:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898007:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898021:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898027:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.898032:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898039:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898051:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137902.898053:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.898057:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898063:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b76aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898077:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898083:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898088:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898093:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.898096:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898111:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898119:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2c00) 00010000:00010000:3.0:1783137902.898121:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.898124:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898130:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b76b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898190:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b76a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d1 expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898203:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b76b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d1 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.898244:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:3.0:1783137902.898247:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137902.898250:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7c00, rc 0) 00000100:00100000:3.0:1783137902.898922:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+32:10488:x1869755299446528:12345-192.168.202.24@tcp:101:cat.0 Request processed in 3004us (3210us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1783137902.898934:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:1.0:1783137902.908312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137902.908523:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299446784 00000100:00100000:0.0:1783137902.908535:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299446784 00000100:00100000:0.0:1783137902.908638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:0.0:1783137902.908650:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+32:10488:x1869755299446784:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1783137902.908943:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+33:10488:x1869755299446784:12345-192.168.202.24@tcp:35:cat.0 Request processed in 293us (641us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783137902.908951:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1783137902.947113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137902.947750:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447040 00000100:00100000:1.0:1783137902.947760:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447040 00000100:00100000:1.0:1783137902.947831:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:1.0:1783137902.947841:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+33:10489:x1869755299447040:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1783137902.947907:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783137902.947938:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b76b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d1 expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.947965:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b768e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ca expref: 32 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.947991:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226bc expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948003:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5de2d1c700) 00010000:00010000:1.0:1783137902.948015:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137902.948040:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948077:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948087:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948104:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948110:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948116:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948901:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948912:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.948919:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137902.952070:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1783137902.952087:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392844541233ns, next at 393844536955ns, rc = 0 00010000:00010000:1.0:1783137902.952180:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952196:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952223:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952264:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952270:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952276:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952307:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783137902.952613:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137902.952621:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.952629:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137902.952634:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.952642:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.952656:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:2.0:1783137902.952660:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137902.952664:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.952670:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b76db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137902.952684:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137902.952686:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137902.952688:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137902.952958:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952966:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952972:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952976:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137902.952980:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952985:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.952994:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:1.0:1783137902.952996:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783137902.953007:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953013:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b76d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953037:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953044:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953050:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953054:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137902.953057:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953063:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953071:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137902.953073:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137902.953075:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137902.953080:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b76c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137902.953090:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f37d82d1 reply state 00000000a3507d18 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137902.953110:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137902.953216:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:10489:x1869755299447040:12345-192.168.202.24@tcp:36:rm.0 Request processed in 5372us (6111us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783137902.953235:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95 00010000:00010000:3.0:1783137902.960027:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960047:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960074:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960080:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137902.960085:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960092:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960110:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc5113f00) 00010000:00010000:3.0:1783137902.960113:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137902.960117:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137902.960123:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b76cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.021125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137903.021693:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447296 00000100:00100000:0.0:1783137903.021722:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447296 00000100:00100000:0.0:1783137903.021899:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:0.0:1783137903.021912:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+31:10495:x1869755299447296:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137903.021941:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137903.024607:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b76e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226d8 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024814:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024830:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024842:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024861:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024870:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.024879:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137903.025974:0:7189:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783137903.026131:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026141:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026157:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026187:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026191:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026196:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026200:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137903.026203:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026207:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026215:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137903.026217:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137903.026220:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026238:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b76e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137903.026254:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f200df2f reply state 000000005a9ab2ff transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137903.026263:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783137903.026307:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b76e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 34 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026617:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 33 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.026626:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137903.026628:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137903.026630:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:0.0:1783137903.026835:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+34:10495:x1869755299447296:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4925us (5720us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783137903.026843:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96 00010000:00010000:2.0:1783137903.029036:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029052:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029075:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029082:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137903.029086:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029093:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029108:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ecb00) 00010000:00010000:2.0:1783137903.029111:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137903.029115:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.029120:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b76f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.035155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.036525:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447424 00000100:00100000:3.0:1783137903.036537:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447424 00000100:00100000:3.0:1783137903.036739:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:3.0:1783137903.036761:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299447424:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783137903.036781:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137903.036814:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226df expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137903.036840:0:7801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137903.036857:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1783137903.036874:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137903.036884:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 6 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.036904:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 6 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.036918:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7000, rc 0) 00000100:00100000:3.0:1783137903.036988:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299447424:12345-192.168.202.24@tcp:101:bash.0 Request processed in 230us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.038866:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:1.0:1783137903.041957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.042057:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447552 00000100:00100000:2.0:1783137903.042066:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447552 00000100:00100000:2.0:1783137903.042156:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:2.0:1783137903.042180:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:10495:x1869755299447552:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137903.042201:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.042223:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226e6 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.042277:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.042307:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137903.042312:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137903.042318:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.042368:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.042383:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.042397:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322537856:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137903.042507:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137903.045850:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322537856:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137903.045885:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.045904:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685800, rc 0) 00000100:00100000:2.0:1783137903.046203:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:10495:x1869755299447552:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4036us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.046213:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:3.0:1783137903.048000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137903.048111:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447680 00000100:00100000:1.0:1783137903.048120:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447680 00010000:00010000:1.0:1783137903.048157:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.048630:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1783137903.048652:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299447680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137903.048668:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137903.048693:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.048709:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.048733:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b7705 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226df expref: 7 pid: 7801 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.048751:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137903.048756:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137903.048764:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.048802:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.048842:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.048858:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb061c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322537984:192.168.202.24@tcp:105: 00000100:00100000:1.0:1783137903.048945:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14aca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137903.057313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137903.057457:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299447936 00000100:00100000:0.0:1783137903.057466:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299447936 00000100:00100000:2.0:1783137903.057599:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb061c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322537984:192.168.202.24@tcp:105: 00010000:00010000:2.0:1783137903.057625:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137903.057719:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299447680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 9079us (9728us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.057728:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:0.0:1783137903.057978:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1783137903.057986:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+33:10495:x1869755299447936:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1783137903.058286:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+34:10495:x1869755299447936:12345-192.168.202.24@tcp:35:bash.0 Request processed in 300us (982us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783137903.058294:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00010000:00010000:3.0:1783137903.098732:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137903.210489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.210664:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448064 00000100:00100000:2.0:1783137903.210675:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448064 00000100:00100000:2.0:1783137903.210747:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:2.0:1783137903.210758:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+34:10511:x1869755299448064:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137903.210796:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.210822:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.210925:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.210942:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.210955:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137903.211020:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1783137903.211024:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137903.211047:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.211071:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ed expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.211093:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ed expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.211112:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137903.211115:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137903.211119:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684600, rc 0) 00000100:00100000:2.0:1783137903.211195:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+35:10511:x1869755299448064:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 439us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.211202:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:1.0:1783137903.217058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.217267:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448320 00000100:00100000:3.0:1783137903.217279:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448320 00000100:00100000:3.0:1783137903.217355:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:3.0:1783137903.217376:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:10511:x1869755299448320:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137903.217405:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137903.217427:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7721 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226f4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.217540:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.217587:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.217620:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137903.217633:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783137903.217795:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7721 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226f4 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.217815:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226f4 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.217823:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:3.0:1783137903.217826:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137903.217829:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6400, rc 0) 00000100:00100000:3.0:1783137903.218001:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+37:10511:x1869755299448320:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 626us (951us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1783137903.218009:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:0.0:1783137903.233059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137903.233108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.233200:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448576 00000100:00100000:2.0:1783137903.233211:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448576 00000100:00100000:2.0:1783137903.233294:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:2.0:1783137903.233306:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+37:10511:x1869755299448576:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137903.233344:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.233374:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7736 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239226fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.233481:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.233495:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.233506:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137903.233518:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783137903.233675:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7736 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226fb expref: 40 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.233710:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226fb expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.233716:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:2.0:1783137903.233718:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137903.233720:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5684200, rc 0) 00000100:00100000:2.0:1783137903.233772:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+39:10511:x1869755299448576:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 470us (724us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783137903.233777:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:1.0:1783137903.234238:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448704 00000100:00100000:1.0:1783137903.234244:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448704 00000100:00100000:1.0:1783137903.234291:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:1.0:1783137903.234300:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+39:2352:x1869755299448704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137903.234312:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137903.234327:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7728 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226f4 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.234338:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:1.0:1783137903.234341:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137903.234377:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+38:2352:x1869755299448704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137903.234391:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783137903.248610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.248707:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448832 00000100:00100000:2.0:1783137903.248718:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448832 00000100:00100000:2.0:1783137903.248778:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:2.0:1783137903.248799:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299448832:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:2.0:1783137903.248846:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.248867:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.248876:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783137903.248880:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137903.248885:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.248920:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.248949:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 6 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.248964:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6616:1869755322538112:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137903.249055:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137903.255045:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6616:1869755322538112:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137903.255072:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.255312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137903.255611:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299448960 00000100:00100000:1.0:1783137903.255638:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299448960 00002000:00100000:1.0:1783137903.255686:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e5dffe3aa00 x1869755299448960/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:54/0 lens 504/0 e 0 to 0 dl 1783137914 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137903.255700:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dffe3aa00 with x1869755299448960 ext(0->8) 00010000:00010000:1.0:1783137903.255708:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 7 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.255723:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 7 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137903.255735:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dffe3aa00 00000100:00100000:1.0:1783137903.255770:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:1.0:1783137903.255783:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299448960:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:1.0:1783137903.256713:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299448960:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 927us (1395us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783137903.256723:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00002000:00100000:1.0:1783137903.256731:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e5dffe3aa00 x1869755299448960/t4294967302(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:54/0 lens 504/448 e 0 to 0 dl 1783137914 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137903.256744:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dffe3aa00 with x1869755299448960 ext(0->8) 00010000:00010000:1.0:1783137903.256750:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.256764:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137903.256771:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dffe3aa00 00000100:00100000:3.0:1783137903.271948:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.272114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449088 00000100:00100000:2.0:1783137903.272124:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449088 00010000:00010000:2.0:1783137903.272168:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.272217:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:2.0:1783137903.272259:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299449088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137903.272275:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783137903.272296:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783137903.272299:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783137902 00002000:00010000:2.0:1783137903.272301:0:5797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783137902 00002000:00010000:2.0:1783137903.272303:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783137902 00010000:00010000:2.0:1783137903.272310:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.272349:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.272390:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6258094/0x4691dfc3d66b770c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226e6 expref: 9 pid: 6617 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.272412:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137903.272416:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137903.272422:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.272431:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.272470:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137903.272532:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299449088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 305us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.272541:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00010000:00010000:0.0:1783137903.272803:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272813:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272852:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272861:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272869:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272881:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137903.272886:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272894:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272907:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.272914:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c81ec68/0x4691dfc3d66b774b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137903.272961:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299448832:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 24174us (24361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137903.272969:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1783137903.286062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.286236:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449344 00000100:00100000:2.0:1783137903.286247:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449344 00000100:00100000:2.0:1783137903.286308:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:2.0:1783137903.286318:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+38:10511:x1869755299449344:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:2.0:1783137903.286612:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226fb expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137903.287040:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1783137903.287089:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1783137903.288040:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1783137903.288115:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.288135:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 42 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.288144:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.288186:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 42 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.288205:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 42 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.288220:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322538240:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137903.288729:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137903.297579:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137903.297608:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322538368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137903.297689:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137903.297885:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322538368 00000100:00100000:0.0:1783137903.297894:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322538368 00000100:00100000:0.0:1783137903.297960:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783137903.297971:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322538368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137903.297994:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137903.298049:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322538368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137903.298056:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783137903.298625:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1783137903.298632:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1783137903.298649:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5dd8033480, transno 4294967301 00000100:00100000:0.0:1783137903.298671:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322538368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137903.299497:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322538240:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137903.299522:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783137903.299720:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137903.300837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137903.301133:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449472 00000100:00100000:1.0:1783137903.301143:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449472 00010000:00010000:1.0:1783137903.301182:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 43 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.301239:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1783137903.301249:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+43:2353:x1869755299449472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137903.301264:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137903.301270:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 43 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301282:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 43 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301303:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b76f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226d8 expref: 43 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301331:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:1.0:1783137903.301337:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301346:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301354:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.301719:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137903.301786:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+42:2353:x1869755299449472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 537us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137903.301795:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00010000:00010000:3.0:1783137903.301860:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.301869:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137903.302007:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783137903.302237:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783137903.302374:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322538496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137903.302444:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137903.302482:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137903.303014:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322538496 00000100:00100000:1.0:1783137903.303021:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322538496 00000100:00100000:1.0:1783137903.303059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137903.303068:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322538496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783137903.303155:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322538496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137903.303161:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137903.303752:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322538496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137903.304299:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1783137903.305112:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322538624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137903.305170:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137903.305255:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137903.305942:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322538624 00000100:00100000:1.0:1783137903.305951:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322538624 00000100:00100000:1.0:1783137903.306059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137903.306069:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322538624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783137903.306317:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1869755322538624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 249us (1146us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783137903.306334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137903.306421:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322538624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137903.306492:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1783137903.306538:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306567:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306574:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306580:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.306585:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306593:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306609:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:3.0:1783137903.306612:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783137903.306616:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.306640:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7752 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137903.306828:0:5814:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783137903.306915:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1783137903.306925:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393199379741ns, next at 394199377731ns, rc = 0 00000001:00080000:3.0:1783137903.306931:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1783137903.306958:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:3.0:1783137903.306961:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783137903.306969:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b773d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226fb expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.307077:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+45:10511:x1869755299449344:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 20760us (21030us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1783137903.307086:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000020:00080000:3.0:1783137903.307090:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783137903.311432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.311764:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449600 00000100:00100000:2.0:1783137903.311776:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449600 00000100:00100000:2.0:1783137903.311845:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:2.0:1783137903.311854:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+45:10511:x1869755299449600:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137903.311879:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.311902:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922702 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.311963:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922702 expref: 46 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.311978:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922702 expref: 46 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.311997:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137903.312000:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137903.312003:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc5685400, rc 0) 00000100:00100000:2.0:1783137903.312058:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+46:10511:x1869755299449600:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 205us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.312065:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:0.0:1783137903.320702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.322249:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449856 00000100:00100000:2.0:1783137903.322263:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449856 00000100:00100000:2.0:1783137903.322340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:2.0:1783137903.322361:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:10511:x1869755299449856:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137903.322675:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+47:10511:x1869755299449856:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 324us (1982us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1783137903.322697:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:2.0:1783137903.483495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.483847:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299449984 00000100:00100000:3.0:1783137903.483857:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299449984 00000100:00100000:3.0:1783137903.483918:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:3.0:1783137903.483927:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+47:10521:x1869755299449984:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:3.0:1783137903.484012:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484031:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484042:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484081:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484088:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484094:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484188:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484197:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484204:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137903.484262:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484274:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484281:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484289:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484295:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.484299:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484312:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484334:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137903.484337:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.484341:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484348:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7760 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484363:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484369:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484375:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484380:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.484785:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484921:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484933:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2e00) 00010000:00010000:3.0:1783137903.484936:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.484939:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484958:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b7767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484975:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484981:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484987:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.484992:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.484996:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.485001:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.485008:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.485010:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.485013:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.485018:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b776e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.485540:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+47:10521:x1869755299449984:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1610us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.485572:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:0.0:1783137903.537243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.537356:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299450240 00000100:00100000:2.0:1783137903.537368:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299450240 00000100:00100000:2.0:1783137903.537438:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:2.0:1783137903.537448:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+47:10524:x1869755299450240:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137903.537471:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.537493:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922709 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537827:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537843:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537855:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537871:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537877:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.537883:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538038:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538064:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538072:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137903.538083:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783137903.538187:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538195:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538201:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538207:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5684200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137903.538211:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538219:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538244:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137903.538248:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137903.538252:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538258:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684200/0x4691dfc3d66b777c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538273:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538285:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538290:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538295:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137903.538298:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538304:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538311:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5de2d1cb00) 00010000:00010000:2.0:1783137903.538314:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137903.538325:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538332:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685800/0x4691dfc3d66b7783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538375:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684e00/0x4691dfc3d66b7775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 50 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538398:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 49 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.538406:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137903.538408:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137903.538416:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d000, rc 0) 00000100:00100000:2.0:1783137903.538489:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+49:10524:x1869755299450240:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1041us (1269us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1783137903.538497:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:0.0:1783137903.544433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137903.545933:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299450368 00000100:00100000:1.0:1783137903.545946:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299450368 00000100:00100000:1.0:1783137903.546086:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:1.0:1783137903.546097:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+49:10524:x1869755299450368:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:1.0:1783137903.546174:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546193:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546205:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546266:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546273:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546279:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546285:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137903.546290:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546297:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546310:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137903.546314:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137903.546318:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.546335:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.546437:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+49:10524:x1869755299450368:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 341us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137903.546445:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:0.0:1783137903.553940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.557750:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299450624 00000100:00100000:2.0:1783137903.557766:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299450624 00000100:00100000:2.0:1783137903.557979:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:2.0:1783137903.557991:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+49:10524:x1869755299450624:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137903.559253:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+50:10524:x1869755299450624:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 1257us (5315us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783137903.559265:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:0.0:1783137903.652128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.652203:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299450880 00000100:00100000:2.0:1783137903.652213:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299450880 00000100:00100000:2.0:1783137903.652286:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:2.0:1783137903.652297:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+50:10534:x1869755299450880:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137903.652323:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.652326:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137903.652356:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5684600/0x4691dfc3d66b771a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226ed expref: 50 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652382:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137903.652387:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137903.652402:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d600/0x4691dfc3d66b779f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922710 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652754:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652787:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 50 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652796:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652830:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 50 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.652845:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 50 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.652859:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322538752:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137903.652964:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137903.660066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.660167:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322538752:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137903.660196:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.660519:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451008 00000100:00100000:3.0:1783137903.660527:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451008 00010000:00010000:3.0:1783137903.660629:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 51 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.660670:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1783137903.660679:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+51:2353:x1869755299451008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137903.660696:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137903.660703:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 51 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660714:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 51 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660737:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b778a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922709 expref: 51 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660756:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.660761:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660770:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660778:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.660802:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137903.660858:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+50:2353:x1869755299451008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 179us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.660880:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00010000:00010000:2.0:1783137903.661041:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.661057:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137903.661076:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783137903.661252:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d600/0x4691dfc3d66b779f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 51 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.661279:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 50 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.661287:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137903.661290:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137903.661292:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c000, rc 0) 00000100:00100000:2.0:1783137903.661336:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+50:10534:x1869755299450880:12345-192.168.202.24@tcp:101:bash.0 Request processed in 9042us (9218us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783137903.661344:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:0.0:1783137903.667885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.668016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451264 00000100:00100000:3.0:1783137903.668029:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451264 00000100:00100000:3.0:1783137903.668230:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 105 00000100:00100000:3.0:1783137903.668243:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+50:10534:x1869755299451264:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:3.0:1783137903.668534:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.668812:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.668825:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137903.668884:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1783137903.668911:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e678e7f2 reply state 0000000028ded127 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.668919:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137903.669022:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:10534:x1869755299451264:12345-192.168.202.24@tcp:36:bash.0 Request processed in 781us (1147us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783137903.669029:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 105 00000020:00080000:3.0:1783137903.669034:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783137903.681534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137903.681907:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451392 00000100:00100000:0.0:1783137903.681919:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451392 00000100:00100000:0.0:1783137903.681985:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:0.0:1783137903.681996:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:10534:x1869755299451392:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137903.682023:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137903.682046:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b77bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922717 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682165:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682182:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682191:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682198:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682218:0:5812:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682261:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.682275:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137903.682290:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8030000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322538880:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137903.682388:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab300 going to sleep for 11 seconds 00010000:00010000:3.0:1783137903.687759:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687779:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687787:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687816:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.687821:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687831:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687850:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.687853:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.687857:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687867:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.687874:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137903.688501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.688583:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451520 00000100:00100000:2.0:1783137903.688606:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451520 00010000:00010000:2.0:1783137903.688644:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.688685:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:2.0:1783137903.688695:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:2352:x1869755299451520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137903.688712:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137903.688720:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.688732:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 54 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.688750:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137903.688754:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.688771:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.688778:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.688796:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137903.688855:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:2352:x1869755299451520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 161us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137903.688863:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00010000:00010000:3.0:1783137903.689984:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c000/0x4691dfc3d66b77a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922710 expref: 53 pid: 7189 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137903.690006:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8030000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322538880:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137903.690029:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.690053:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.690059:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137903.690125:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783137903.690130:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137903.690150:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.690184:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b77bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.690200:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.690208:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.690211:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137903.690214:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:3.0:1783137903.690305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:10534:x1869755299451392:12345-192.168.202.24@tcp:101:bash.0 Request processed in 8311us (8781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.690313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:0.0:1783137903.702845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.702939:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451776 00000100:00100000:3.0:1783137903.702951:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451776 00000100:00100000:3.0:1783137903.703016:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:3.0:1783137903.703027:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:10534:x1869755299451776:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:3.0:1783137903.703292:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+53:10534:x1869755299451776:12345-192.168.202.24@tcp:35:bash.0 Request processed in 267us (459us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1783137903.703301:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:1.0:1783137903.764650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.764913:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299451904 00000100:00100000:3.0:1783137903.764927:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299451904 00000100:00100000:3.0:1783137903.765032:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:3.0:1783137903.765043:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+53:10540:x1869755299451904:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137903.765077:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137903.765104:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392271e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765194:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765213:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765237:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137903.765463:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783137903.765468:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137903.765504:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765538:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b77c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392271e expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765779:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392271e expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.765790:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137903.765793:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137903.765797:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7000, rc 0) 00000100:00100000:3.0:1783137903.765870:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299451904:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 829us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.765890:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1783137903.770081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.770191:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452032 00000100:00100000:3.0:1783137903.770204:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452032 00000100:00100000:3.0:1783137903.770295:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:3.0:1783137903.770309:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299452032:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137903.770351:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137903.770382:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b77d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922725 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770474:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770494:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770509:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770526:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770534:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770540:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.770999:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771031:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771039:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137903.771088:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783137903.771093:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137903.771117:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771131:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771143:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771150:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771158:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771164:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.771170:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771179:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771195:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:3.0:1783137903.771199:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.771211:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771230:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b77de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771252:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771259:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771265:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771270:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137903.771273:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771279:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771288:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dc39a2e00) 00010000:00010000:3.0:1783137903.771290:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137903.771294:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771300:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b77e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771345:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b77d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922725 expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771378:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922725 expref: 55 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.771387:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.771389:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137903.771392:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7800, rc 0) 00000100:00100000:3.0:1783137903.771487:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:10540:x1869755299452032:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1180us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.771497:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:0.0:1783137903.777117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137903.777175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.777294:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452416 00000100:00100000:3.0:1783137903.777309:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452416 00000100:00100000:3.0:1783137903.777413:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1783137903.777428:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:2350:x1869755299452416:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137903.777456:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137903.777495:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b77ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922725 expref: 55 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.777524:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.777529:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137903.777641:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:2350:x1869755299452416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 215us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.777650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1783137903.778331:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452288 00000100:00100000:2.0:1783137903.778342:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452288 00000100:00100000:2.0:1783137903.778394:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:2.0:1783137903.778404:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299452288:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137903.778429:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137903.778454:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d600/0x4691dfc3d66b77f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392272c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.778878:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.778898:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.778908:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.778956:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137903.778987:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 55 pid: 5812 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137903.779003:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322539008:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137903.779349:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c01e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137903.797863:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137903.798073:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322539008:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137903.798111:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.798252:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452544 00000100:00100000:1.0:1783137903.798281:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452544 00010000:00010000:1.0:1783137903.798340:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 56 pid: 5812 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137903.798387:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:1.0:1783137903.798397:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+56:2353:x1869755299452544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137903.798417:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137903.798425:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 56 pid: 5812 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798438:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 56 pid: 5812 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798468:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b77c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922717 expref: 56 pid: 5812 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798488:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137903.798494:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798505:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798514:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137903.798581:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137903.798796:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:2353:x1869755299452544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 399us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137903.798817:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00010000:00010000:3.0:1783137903.799006:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.799016:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137903.799053:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783137903.799286:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d600/0x4691dfc3d66b77f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.799309:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.799317:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.799320:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783137903.799322:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d200, rc 0) 00000100:00100000:3.0:1783137903.799357:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+55:10540:x1869755299452288:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 20956us (22257us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1783137903.799365:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 109 00000100:00100000:1.0:1783137903.804111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.804332:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452800 00000100:00100000:3.0:1783137903.804348:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452800 00000100:00100000:3.0:1783137903.804447:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1783137903.804463:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:10540:x1869755299452800:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:3.0:1783137903.804492:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137903.804533:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685400/0x4691dfc3d66b7759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922702 expref: 55 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.804599:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137903.804851:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137903.805283:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299452800:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 819us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137903.805293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1783137903.807648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137903.807754:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299452928 00000100:00100000:3.0:1783137903.807767:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299452928 00000100:00100000:3.0:1783137903.807829:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:3.0:1783137903.807857:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299452928:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:3.0:1783137903.807992:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.808012:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137903.808026:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137903.808294:0:7189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1783137903.808387:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299452928:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 530us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137903.808394:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 110 00000100:00100000:3.0:1783137903.811185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137903.811339:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453056 00000100:00100000:1.0:1783137903.811352:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453056 00000100:00100000:1.0:1783137903.811425:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:1.0:1783137903.811436:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+54:10540:x1869755299453056:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137903.811464:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137903.811492:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922733 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812462:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812490:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812522:0:5811:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812541:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812908:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137903.812912:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137903.812917:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137903.812925:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6dc00, rc 0) 00000100:00100000:0.0:1783137903.813068:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:10540:x1869755299453056:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1632us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137903.813077:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 111 00010000:00010000:1.0:1783137904.122853:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137904.506941:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137904.506954:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137904.507035:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783137904.507046:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783137904.507229:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322539136:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783137904.507525:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137904.519673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.519826:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4205f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322539136:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783137904.520469:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453184 00000100:00100000:2.0:1783137904.520481:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453184 00000100:00100000:2.0:1783137904.520609:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:2.0:1783137904.520623:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:10541:x1869755299453184:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137904.520667:0:7189:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137904.520828:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:10541:x1869755299453184:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 208us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137904.520838:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00080000:1.0:1783137904.524525:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137904.525882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.531082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453312 00000100:00100000:0.0:1783137904.531109:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453312 00000100:00100000:0.0:1783137904.531249:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:0.0:1783137904.531265:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:10541:x1869755299453312:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783137904.531635:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531657:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531673:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531879:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531906:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531920:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531956:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531966:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.531993:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137904.532046:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783137904.532050:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137904.532063:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532074:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532081:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532088:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532093:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137904.532098:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532105:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532118:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:0.0:1783137904.532122:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137904.532138:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532145:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7816 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532175:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532181:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532188:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532194:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137904.532199:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532205:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532222:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e5dcc9ecf00) 00010000:00010000:0.0:1783137904.532225:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137904.532227:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532233:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b781d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532248:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532254:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532260:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532270:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137904.532274:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532280:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532287:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137904.532289:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137904.532292:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.532297:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137904.533728:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:10541:x1869755299453312:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 2459us (8247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.533741:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:1.0:1783137904.547557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137904.547668:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453568 00000100:00100000:2.0:1783137904.547685:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453568 00000100:00100000:2.0:1783137904.547906:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:2.0:1783137904.547922:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:10541:x1869755299453568:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137904.547953:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137904.547981:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b782b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392273a expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548146:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548167:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548182:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137904.548195:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783137904.548383:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548392:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548399:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548405:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3da00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.548411:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548420:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548434:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137904.548438:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137904.548443:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548460:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3da00/0x4691dfc3d66b7832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548515:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b782b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392273a expref: 57 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548526:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:2.0:1783137904.548529:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137904.548533:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b782b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392273a expref: 57 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.548571:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3ca00, rc 0) 00000100:00100000:2.0:1783137904.548666:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+56:10541:x1869755299453568:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 748us (1141us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1783137904.553816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.555111:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453696 00000100:00100000:0.0:1783137904.555129:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453696 00000100:00100000:0.0:1783137904.555243:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:0.0:1783137904.555258:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299453696:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783137904.555329:0:5813:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783137904.555485:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299453696:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 230us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.555494:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:2.0:1783137904.557749:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:3.0:1783137904.574136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.574820:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299453952 00000100:00100000:0.0:1783137904.574835:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299453952 00000100:00100000:0.0:1783137904.574942:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:0.0:1783137904.574954:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+56:10541:x1869755299453952:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137904.574982:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137904.574986:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783137904.575023:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b77d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392271e expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.575050:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:0.0:1783137904.575056:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137904.575073:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7840 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922741 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137904.575770:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783137904.576050:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.576068:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.576081:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.576154:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7840 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922741 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.576175:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922741 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.576183:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ecf00) 00010000:00010000:0.0:1783137904.576199:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137904.576202:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031000, rc 0) 00000100:00100000:0.0:1783137904.576306:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299453952:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1353us (2185us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783137904.576316:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:1.0:1783137904.590482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.590638:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299454208 00000100:00100000:3.0:1783137904.590652:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299454208 00000100:00100000:3.0:1783137904.590729:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:3.0:1783137904.590742:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299454208:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137904.590825:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137904.590864:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b7847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922741 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.590905:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ecf00) 00010000:00010000:3.0:1783137904.590918:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137904.590962:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.590979:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.590990:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600291:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600337:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600354:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600484:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600493:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600526:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600533:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.600538:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600591:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600609:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:2.0:1783137904.600613:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137904.600619:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600625:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7855 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600644:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600651:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600657:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600662:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.600665:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600682:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600691:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2f2fc772 (ffff8e5de2d1cb00) 00010000:00010000:2.0:1783137904.600694:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137904.600697:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.600703:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b785c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2f2fc772 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.600847:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+56:10541:x1869755299454208:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 10102us (10372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137904.600869:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:3.0:1783137904.613949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.614114:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299454336 00000100:00100000:0.0:1783137904.614124:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299454336 00000100:00100000:0.0:1783137904.614188:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:0.0:1783137904.614199:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+56:10541:x1869755299454336:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137904.614230:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137904.614257:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7863 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922748 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614291:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614306:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614317:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614426:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614447:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.614456:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137904.614466:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137904.614471:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:0.0:1783137904.614532:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299454336:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 335us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.614540:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:2.0:1783137904.624509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.624676:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299454592 00000100:00100000:3.0:1783137904.624693:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299454592 00000100:00100000:3.0:1783137904.624775:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:3.0:1783137904.624788:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+57:10541:x1869755299454592:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137904.626172:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.626203:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.626227:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137904.626631:0:7189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1783137904.626644:0:7189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394519098763ns, next at 395519095003ns, rc = 0 00000004:00010000:2.0:1783137904.626761:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c25a69d6 reply state 00000000934c21c5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.626786:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137904.627127:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+59:10541:x1869755299454592:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 2335us (2624us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783137904.627139:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:1.0:1783137904.632620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.632693:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299454720 00000100:00100000:0.0:1783137904.632708:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299454720 00000100:00100000:0.0:1783137904.632782:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:0.0:1783137904.632793:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+59:10541:x1869755299454720:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137904.632819:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137904.632857:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392274f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.632928:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.632943:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.632964:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137904.632968:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137904.632971:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:0.0:1783137904.633049:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+60:10541:x1869755299454720:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 257us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.633056:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00010000:00010000:2.0:1783137904.633129:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633144:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633151:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633158:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.633163:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633172:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633199:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137904.633203:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137904.633209:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.633228:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7871 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.653712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137904.656327:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299454848 00000100:00100000:1.0:1783137904.656351:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299454848 00000100:00100000:1.0:1783137904.656471:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1783137904.656485:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299454848:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783137904.658834:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299454848:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 2335us (5114us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783137904.658850:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00080000:0.0:1783137904.659530:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137904.665802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.665979:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299455104 00000100:00100000:3.0:1783137904.665991:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299455104 00000100:00100000:3.0:1783137904.666051:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:3.0:1783137904.666062:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+59:10541:x1869755299455104:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783137904.666446:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+60:10541:x1869755299455104:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 383us (651us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783137904.666455:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1783137904.680298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.680595:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299455360 00000100:00100000:0.0:1783137904.680620:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299455360 00000100:00100000:0.0:1783137904.680684:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:0.0:1783137904.680696:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+60:10541:x1869755299455360:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137904.680819:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+60:10541:x1869755299455360:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 125us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.680827:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:0.0:1783137904.688400:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137904.688627:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299455488 00000100:00100000:1.0:1783137904.688638:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299455488 00000100:00100000:1.0:1783137904.688706:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:1.0:1783137904.688715:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+60:10541:x1869755299455488:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137904.688736:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137904.688755:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b787f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922756 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688820:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688843:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688854:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137904.688892:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137904.688910:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688935:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b787f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922756 expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688953:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922756 expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.688960:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137904.688963:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783137904.688966:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c200, rc 0) 00000100:00100000:1.0:1783137904.689037:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+61:10541:x1869755299455488:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 323us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137904.689053:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:1.0:1783137904.696343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.696434:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299455616 00000100:00100000:3.0:1783137904.696443:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299455616 00000100:00100000:3.0:1783137904.696500:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1783137904.696511:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+9:2353:x1869755299455616:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137904.696529:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137904.696583:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392275d expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137904.696625:0:7801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48866f, blocks: 0x1 00010000:00010000:3.0:1783137904.696645:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1783137904.696649:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137904.696660:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 10 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.696689:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 10 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.696704:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7c00, rc 0) 00000100:00100000:3.0:1783137904.696763:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+10:2353:x1869755299455616:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137904.696771:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1783137904.701776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.701965:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299455872 00000100:00100000:0.0:1783137904.701977:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299455872 00000100:00100000:0.0:1783137904.702071:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1783137904.702083:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+61:10541:x1869755299455872:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137904.702236:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+61:10541:x1869755299455872:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 154us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.702244:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:1.0:1783137904.708156:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137904.708290:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456000 00000100:00100000:2.0:1783137904.708303:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456000 00000100:00100000:2.0:1783137904.708391:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:2.0:1783137904.708424:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+10:10541:x1869755299456000:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137904.708450:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137904.708476:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922764 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.708526:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.708538:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137904.708583:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137904.708590:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 11 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.708636:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.708652:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.708669:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322539264:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137904.708804:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc851cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137904.712696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137904.713012:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322539264:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137904.713059:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 11 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.713123:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d400, rc 0) 00000100:00100000:2.0:1783137904.713202:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+11:10541:x1869755299456000:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 4780us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137904.713227:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137904.714594:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456128 00000100:00100000:3.0:1783137904.714622:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456128 00010000:00010000:3.0:1783137904.714679:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.714731:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1783137904.714743:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+11:2352:x1869755299456128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137904.714763:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137904.714804:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.714843:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.714874:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b788d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392275d expref: 11 pid: 7801 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.714895:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137904.714899:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137904.714908:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.714920:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.714970:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.714988:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1869755322539392:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783137904.715107:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137904.728696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137904.729113:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456256 00000100:00100000:2.0:1783137904.729126:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456256 00002000:00100000:2.0:1783137904.729203:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e5e01430380 x1869755299456256/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:55/0 lens 504/0 e 0 to 0 dl 1783137915 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137904.729226:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5e01430380 with x1869755299456256 ext(0->12) 00002000:00010000:2.0:1783137904.729235:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5e01430380 00000100:00100000:2.0:1783137904.729281:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1783137904.729292:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+11:2352:x1869755299456256:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783137904.729941:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+13:2352:x1869755299456256:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 646us (1259us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783137904.729951:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00002000:00100000:2.0:1783137904.729962:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e5e01430380 x1869755299456256/t4294967308(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:55/0 lens 504/448 e 0 to 0 dl 1783137915 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137904.729972:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5e01430380 with x1869755299456256 ext(0->12) 00002000:00010000:2.0:1783137904.729976:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5e01430380 00000100:00100000:3.0:1783137904.730999:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1869755322539392:192.168.202.24@tcp:105: 00010000:00010000:3.0:1783137904.731034:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137904.731102:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+12:2352:x1869755299456128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 16361us (18420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137904.731112:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1783137904.734812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.734934:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456384 00000100:00100000:0.0:1783137904.734948:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456384 00000100:00100000:0.0:1783137904.735035:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:0.0:1783137904.735046:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+61:10541:x1869755299456384:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783137904.831703:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000100:00100000:1.0:1783137904.833226:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+47:10541:x1869755299456384:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 98153us (98402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137904.833244:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124 00000004:00080000:1.0:1783137904.833307:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783137904.833346:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1783137904.833373:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1783137904.833377:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1783137904.833418:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5dd13f6000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783137904.833424:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd81c5300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dd13f6b40 00000020:00080000:1.0:1783137904.833428:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd81c5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dc3dbe400 00000001:00080000:1.0:1783137904.833442:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1783137904.833461:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1783137904.833482:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5dfa181d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783137904.833485:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dc57ad300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dfa181840 00000020:00080000:1.0:1783137904.833489:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dc57adb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dfb109000 00000020:00080000:2.0:1783137904.833656:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1783137904.833711:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322539520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783137904.833761:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322539648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783137904.833799:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137904.833824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137904.833893:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137904.833917:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322539776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783137904.833921:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322539520 00000100:00100000:1.0:1783137904.833931:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322539520 00000100:00100000:3.0:1783137904.833954:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137904.834018:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322539648 00000100:00100000:1.0:1783137904.834021:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322539648 00000100:00100000:3.0:1783137904.834025:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322539776 00000100:00100000:3.0:1783137904.834031:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322539776 00000100:00100000:1.0:1783137904.834088:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000020:00080000:2.0:1783137904.834116:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783137904.834234:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137904.834247:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322539776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783137904.834420:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322539520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783137904.834441:0:7801:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1783137904.834483:0:7801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a48866e, atime: 0x6a48866e, ctime: 0x6a48866e, blocks: 0x1 00010000:00010000:1.0:1783137904.834493:0:7801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.834514:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1783137904.834520:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137904.834527:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.834577:0:7801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.834590:0:7801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.834599:0:7801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137904.834625:0:6616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783137904.834630:0:6616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783137903 00010000:00010000:1.0:1783137904.834631:0:7801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783137904.834633:0:6616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783137904.834637:0:6616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783137903 -> 1783137903 00002000:00010000:3.0:1783137904.834640:0:6616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783137904.834688:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1869755322539776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 444us (735us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783137904.834696:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137904.834717:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783137904.834724:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322539648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783137904.834737:0:6616:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1783137904.834751:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.834769:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 11 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.835432:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783137904.835446:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137904.835451:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.835492:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 11 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.835510:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 11 pid: 7801 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.835525:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322539904:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137904.835645:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181300 going to sleep for 11 seconds 00010000:00010000:2.0:1783137904.836279:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137904.836293:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.836317:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137904.836323:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.836348:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.836376:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.836384:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e00bf5/0x4691dfc3d66b789b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.836415:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137904.836417:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137904.836419:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137904.836768:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322539520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2668us (2967us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783137904.836781:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783137904.836842:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783137904.836984:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5e01430e00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1783137904.836993:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322539520:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1783137904.837236:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5dff978a80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1783137904.837243:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322539776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783137904.842365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.842655:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456512 00000100:00100000:3.0:1783137904.842668:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456512 00000100:00100000:3.0:1783137904.842743:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1783137904.842755:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+12:2353:x1869755299456512:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783137904.847492:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322539904:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137904.847507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1783137904.847541:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137904.847662:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456640 00000100:00100000:1.0:1783137904.847673:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456640 00010000:00010000:1.0:1783137904.847724:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 13 pid: 7801 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137904.847762:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1783137904.847774:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+13:2352:x1869755299456640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137904.847794:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137904.847801:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 13 pid: 7801 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.847814:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 13 pid: 7801 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.847856:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fd53413/0x4691dfc3d66b765d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226c3 expref: 13 pid: 7801 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.847885:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137904.847890:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137904.847897:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.847908:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.847964:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137904.848037:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+12:2352:x1869755299456640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 264us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137904.848046:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00010000:00010000:1.0:1783137904.848156:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848165:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848178:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848185:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848204:0:6616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137904.848778:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137904.848787:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848797:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137904.848801:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848823:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848837:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848845:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b78a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.848869:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137904.848872:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137904.848873:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137904.850885:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1869755322539648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16150us (17054us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783137904.850901:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1783137904.851207:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5dff97a300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783137904.851230:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322539648:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1783137904.907111:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1783137904.907141:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1783137904.907160:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1783137904.907185:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1783137904.907408:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299456512:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 64646us (65051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137904.907423:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1783137904.910658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137904.910942:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299456896 00000100:00100000:2.0:1783137904.910956:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299456896 00000100:00100000:2.0:1783137904.911037:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:2.0:1783137904.911051:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+15:10541:x1869755299456896:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137904.911151:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137904.911189:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b7886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922756 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.911224:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137904.911230:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137904.911441:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.911461:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.911472:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137904.911890:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8762d2f reply state 0000000034f4ac99 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.911901:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137904.912020:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+16:10541:x1869755299456896:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 971us (1376us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783137904.912029:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00010000:00010000:1.0:1783137904.919400:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919427:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919436:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919442:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137904.919447:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919486:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919510:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137904.919514:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137904.919520:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.919527:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b78a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137904.929854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137904.930078:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457024 00000100:00100000:1.0:1783137904.930093:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457024 00000100:00100000:1.0:1783137904.930318:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1783137904.930331:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299457024:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783137904.931206:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783137904.931223:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783137903 -> 1783137902 00002000:00010000:1.0:1783137904.931226:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783137902 00002000:00010000:1.0:1783137904.931229:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783137903 -> 1783137902 00002000:00010000:1.0:1783137904.931231:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783137904.931490:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299457024:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 1157us (1644us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783137904.931501:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:2.0:1783137904.933983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.934098:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457280 00000100:00100000:3.0:1783137904.934111:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457280 00000100:00100000:3.0:1783137904.934818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:3.0:1783137904.934836:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:10541:x1869755299457280:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783137904.934936:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.934957:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.934968:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.935014:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.935031:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 15 pid: 5812 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.935050:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322540032:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137904.935174:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137904.937943:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322540032:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137904.937984:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.938986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137904.939132:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457408 00000100:00100000:1.0:1783137904.939431:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457408 00010000:00010000:1.0:1783137904.939484:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 16 pid: 5812 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137904.939587:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1783137904.940006:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+16:2353:x1869755299457408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137904.940034:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137904.940043:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 16 pid: 5812 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940058:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 16 pid: 5812 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940089:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b786a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922748 expref: 16 pid: 5812 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940110:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137904.940117:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940129:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940220:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.940473:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137904.940602:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+15:2353:x1869755299457408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 998us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137904.940612:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00010000:00010000:0.0:1783137904.941919:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.941936:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.941980:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.941988:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.941997:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.942004:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137904.942010:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.942018:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.942037:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137904.942040:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783137904.942044:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.942073:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b78b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137904.942382:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+14:10541:x1869755299457280:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 7544us (8412us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783137904.942394:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1783137904.949928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137904.950247:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457536 00000100:00100000:1.0:1783137904.950290:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457536 00000100:00100000:1.0:1783137904.950479:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:1.0:1783137904.950491:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299457536:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783137904.950590:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.950627:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.950839:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137904.950844:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137904.950849:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.950899:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.950916:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 7 pid: 6617 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137904.950934:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc23c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322540160:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137904.951057:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7ea4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137904.955105:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc23c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322540160:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137904.955161:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.958856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.959277:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457664 00000100:00100000:3.0:1783137904.959292:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457664 00010000:00010000:3.0:1783137904.959465:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 8 pid: 6617 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.959521:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:3.0:1783137904.959532:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299457664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137904.959577:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137904.959627:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 8 pid: 6617 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.959642:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 8 pid: 6617 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.959672:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922764 expref: 8 pid: 6617 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.959695:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137904.959699:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137904.959706:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.959717:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.959751:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137904.959846:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299457664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 315us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137904.959856:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00010000:00010000:1.0:1783137904.960844:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960863:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960906:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960916:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960925:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960933:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137904.960938:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960948:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.960970:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137904.961001:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b78b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137904.961111:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2351:x1869755299457536:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 10618us (11200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137904.961121:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:2.0:1783137904.977147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.978173:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299457920 00000100:00100000:0.0:1783137904.978191:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299457920 00000100:00100000:0.0:1783137904.978979:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:0.0:1783137904.979005:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+14:10541:x1869755299457920:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783137904.979131:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979154:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979171:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979505:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979518:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979527:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979759:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.979805:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 15 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137904.979824:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322540288:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137904.979963:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137904.982979:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322540288:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137904.983023:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137904.985464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137904.985790:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299458048 00000100:00100000:3.0:1783137904.985805:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299458048 00010000:00010000:3.0:1783137904.985866:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 16 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.985971:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1783137904.985985:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+16:2353:x1869755299458048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137904.986028:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137904.986038:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 16 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986054:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 16 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986082:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b7878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392274f expref: 16 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986105:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137904.986110:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986121:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986128:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.986161:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137904.986247:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:2353:x1869755299458048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 264us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137904.986267:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00010000:00010000:0.0:1783137904.986483:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137904.986492:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137904.986800:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1783137904.986937:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783137904.986971:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1783137904.987062:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7189:1869755322540416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783137904.987116:0:7189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137904.987150:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137904.989068:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322540416 00000100:00100000:2.0:1783137904.989107:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322540416 00000100:00100000:2.0:1783137904.989182:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137904.989194:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7189:x1869755322540416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783137904.989374:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7189:x1869755322540416:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137904.989383:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137904.989925:0:7189:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1783137904.989935:0:7189:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1783137904.989965:0:7189:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5dff978a80, transno 4294967309 00000100:00100000:0.0:1783137904.989985:0:7189:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5dff97a300 x1869755322539648/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783137920 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137904.990001:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7189:1869755322540416:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1783137904.991093:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1783137904.991183:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7189:1869755322540544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783137904.991266:0:7189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137904.991304:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137904.991312:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322540544 00000100:00100000:2.0:1783137904.991320:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322540544 00000100:00100000:2.0:1783137904.991381:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137904.991392:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7189:x1869755322540544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783137904.991658:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7189:x1869755322540544:12345-0@lo:1000:mdt00_003.0 Request processed in 267us (392us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783137904.991667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137904.992122:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7189:1869755322540544:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783137904.992191:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992205:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992240:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992247:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137904.992352:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992363:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992386:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137904.992389:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137904.992394:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992400:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b78c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992445:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992452:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992458:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992462:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137904.992464:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992477:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992483:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137904.992485:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137904.992492:0:7189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992502:0:7189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992510:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.992537:0:7189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137904.992570:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322540672:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783137904.992715:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137904.996198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137904.996492:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299458176 00000100:00100000:0.0:1783137904.996504:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299458176 00000100:00100000:0.0:1783137904.996608:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:0.0:1783137904.996621:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:10540:x1869755299458176:12345-192.168.202.24@tcp:49:lfs.0 00000100:00100000:0.0:1783137904.996812:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:10540:x1869755299458176:12345-192.168.202.24@tcp:49:lfs.0 Request processed in 193us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137904.996820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:3.0:1783137904.998155:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322540672:192.168.202.24@tcp:105: 00010000:00010000:3.0:1783137904.998199:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137904.998222:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7808 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998646:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998667:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998680:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998694:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998700:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998769:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998794:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.998799:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998807:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998823:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137904.998827:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137904.998831:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998836:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b78cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998848:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998854:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998860:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998864:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137904.998867:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998873:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998892:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:2.0:1783137904.998895:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137904.998898:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137904.998904:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137905.000160:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+18:10541:x1869755299457920:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 21155us (23016us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1783137905.000177:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000020:00080000:2.0:1783137905.000185:0:7189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783137905.001509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137905.001641:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299458432 00000100:00100000:3.0:1783137905.001677:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299458432 00000100:00100000:3.0:1783137905.001749:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:3.0:1783137905.001762:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+18:10540:x1869755299458432:12345-192.168.202.24@tcp:58:lfs.0 00000040:00080000:3.0:1783137905.002287:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1783137905.002417:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+18:10540:x1869755299458432:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 656us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137905.002427:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:1.0:1783137905.004239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137905.004478:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299458688 00000100:00100000:0.0:1783137905.004489:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299458688 00000100:00100000:0.0:1783137905.004574:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1783137905.004585:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6704850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+18:10541:x1869755299458688:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1783137905.006084:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137905.006092:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137905.006145:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783137905.006152:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1783137905.007157:0:5815:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1783137905.007532:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322540800:192.168.202.24@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1783137905.008791:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1783137905.008907:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.008930:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.008944:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.008955:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.008974:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.008980:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137905.009150:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021da80 going to sleep for 11 seconds 00010000:00010000:0.0:1783137905.009765:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137905.009877:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6704850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:10541:x1869755299458688:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 5288us (5659us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1783137905.009890:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000020:00080000:0.0:1783137905.009898:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137905.010117:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137905.010127:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137905.010137:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137905.010143:0:7510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137905.010155:0:7510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137905.010189:0:7510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e5dcc9ece00) 00010000:00010000:2.0:1783137905.010193:0:7510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137905.010199:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137905.010206:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137905.010241:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137905.010243:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137905.010245:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137905.012565:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322540800:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137905.019739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137905.020265:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299458816 00000100:00100000:2.0:1783137905.020281:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299458816 00000100:00100000:2.0:1783137905.020371:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:2.0:1783137905.020385:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:10542:x1869755299458816:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137905.020438:0:5811:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137905.021319:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:10542:x1869755299458816:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 924us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137905.021330:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:1.0:1783137905.029388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137905.029461:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299459072 00000100:00100000:3.0:1783137905.029475:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299459072 00000100:00100000:3.0:1783137905.029585:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:3.0:1783137905.029597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:10542:x1869755299459072:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137905.029634:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137905.029664:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b78da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392276b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137905.029812:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b78e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137905.029831:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b78e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137905.029846:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b78e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137905.029861:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783137905.030037:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b78da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392276b expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137905.030060:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b78e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392276b expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137905.030102:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137905.030106:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783137905.030111:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6400, rc 0) 00000100:00100000:3.0:1783137905.030197:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+22:10542:x1869755299459072:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 592us (816us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1783137905.030206:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:2.0:1783137905.044124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137905.045642:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299459328 00000100:00100000:0.0:1783137905.045659:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299459328 00000100:00100000:0.0:1783137905.045748:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:0.0:1783137905.045761:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+22:10542:x1869755299459328:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783137905.045880:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.045904:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.045920:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046174:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046182:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046218:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046226:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137905.046232:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046243:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046270:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137905.046274:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137905.046281:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.046288:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137905.046740:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+23:10542:x1869755299459328:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 978us (2627us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1783137905.046750:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131 00000040:00080000:2.0:1783137905.051280:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137905.051295:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137905.052254:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783137905.052272:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137905.072376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137905.072482:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299459584 00000100:00100000:3.0:1783137905.072496:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299459584 00000100:00100000:3.0:1783137905.072631:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1783137905.072645:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+23:10542:x1869755299459584:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783137905.073012:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+24:10542:x1869755299459584:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 369us (652us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783137905.073021:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1783137905.083193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137905.083936:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299459712 00000100:00100000:0.0:1783137905.083953:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299459712 00000100:00100000:0.0:1783137905.084034:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:0.0:1783137905.084048:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:10544:x1869755299459712:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137905.084078:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137905.084106:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922772 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084461:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084481:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084496:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084513:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084519:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.084526:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.085060:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.085078:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.085090:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.085143:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.085180:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 25 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137905.085200:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322540928:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137905.087958:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137905.091859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137905.092329:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322540928:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137905.092370:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137905.092621:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299459968 00000100:00100000:3.0:1783137905.092632:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299459968 00000100:00100000:3.0:1783137905.092713:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:3.0:1783137905.092725:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:5579:x1869755299459968:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783137905.093052:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:5579:x1869755299459968:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 327us (1207us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783137905.093061:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:1.0:1783137905.099801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137905.099954:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460096 00000100:00100000:0.0:1783137905.099967:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460096 00010000:00010000:0.0:1783137905.102567:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 27 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137905.102870:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:0.0:1783137905.102885:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:2353:x1869755299460096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137905.102911:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137905.102920:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 27 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.102936:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 27 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.102967:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b77fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392272c expref: 27 pid: 5813 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.103013:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137905.103019:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.103030:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.103040:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137905.105346:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137905.105474:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:2353:x1869755299460096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2582us (6214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137905.105488:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00010000:00010000:1.0:1783137905.109528:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.109566:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137905.109975:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783137905.109981:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137905.110010:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110030:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110043:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110076:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110083:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110090:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137905.110095:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110104:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110130:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137905.110134:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137905.110140:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110145:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b78fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110168:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110174:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110180:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110185:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137905.110195:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110202:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110220:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e5dcc9ecd00) 00010000:00010000:1.0:1783137905.110224:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137905.110235:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110243:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110303:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031000/0x4691dfc3d66b78f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922772 expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110327:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922772 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137905.110335:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137905.110337:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137905.110340:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030600, rc 0) 00000100:00100000:1.0:1783137905.113857:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+25:10544:x1869755299459712:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 29788us (30656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137905.113880:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132 00010000:00010000:2.0:1783137905.148503:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137905.343852:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322541184:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.343956:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137905.344028:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322541696:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.344058:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137905.344099:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137905.344107:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322541056:0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.344116:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322541440:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.344142:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137905.344169:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322541568:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.344197:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137905.344234:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322541312:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.344259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137905.344269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137905.344314:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541696 00000100:00100000:0.0:1783137905.344325:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541696 00000100:00100000:3.0:1783137905.344337:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541056 00000100:00100000:3.0:1783137905.344354:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541056 00000100:00100000:0.0:1783137905.344405:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541440 00000100:00100000:0.0:1783137905.344409:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541440 00000100:00100000:3.0:1783137905.344423:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783137905.344438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322541056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.344452:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137905.344461:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322541696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.344517:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322541056:12345-0@lo:400:kworker.0 Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137905.344525:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1783137905.344571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541184 00000100:00100000:2.0:1783137905.344577:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541184 00000100:00100000:3.0:1783137905.344596:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541568 00000100:00100000:3.0:1783137905.344602:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541568 00000100:00100000:2.0:1783137905.344622:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541312 00000100:00100000:2.0:1783137905.344627:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541312 00000100:00100000:3.0:1783137905.344631:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783137905.344640:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322541184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137905.344656:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783137905.344667:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322541568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.350677:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322541696:12345-0@lo:400:kworker.0 Request processed in 6202us (6602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137905.350697:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137905.350749:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137905.350772:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1869755322541440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.350890:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1869755322541440:12345-0@lo:400:kworker.0 Request processed in 132us (6725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137905.350897:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137905.350934:0:7189:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783137905.350944:0:7189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1783137905.350964:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137905.350971:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137905.351506:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783137905.351523:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322541312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.351614:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322541312:12345-0@lo:400:kworker.0 Request processed in 97us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137905.351622:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783137905.351687:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322541312:0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.351889:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322541184:12345-0@lo:400:kworker.0 Request processed in 7246us (7930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137905.351899:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783137905.351951:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322541440:0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.352273:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322541056:0@lo:400:kworker.0 00000100:00100000:2.0:1783137905.354668:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322541568:12345-0@lo:400:kworker.0 Request processed in 9988us (10454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137905.354686:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783137905.359638:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322541568:0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.359665:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322541184:0@lo:400:kworker.0 00000100:00100000:3.0:1783137905.359681:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322541696:0@lo:400:kworker.0 00000100:00100000:0.0:1783137905.866796:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322541824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137905.866997:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137905.867400:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541824 00000100:00100000:1.0:1783137905.867412:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541824 00000100:00100000:1.0:1783137905.867488:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783137905.867501:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322541824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137905.867568:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783137905.867639:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322541824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137905.867647:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137905.868509:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322541824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137906.171113:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783137906.343107:0:11990:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137906.343119:0:11990:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137906.343173:0:11990:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783137906.343184:0:11990:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137906.532091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137906.532245:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460352 00000100:00100000:0.0:1783137906.532260:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460352 00000100:00100000:0.0:1783137906.532367:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:0.0:1783137906.532379:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+25:10567:x1869755299460352:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137906.532413:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137906.532438:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922779 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.532596:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.532625:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.532638:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137906.532653:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783137906.532842:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031200/0x4691dfc3d66b7912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922779 expref: 28 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.532862:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922779 expref: 27 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.532873:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:0.0:1783137906.532881:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783137906.532885:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0030c00, rc 0) 00000100:00100000:0.0:1783137906.532979:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:10567:x1869755299460352:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 602us (902us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1783137906.532996:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00080000:2.0:1783137906.533058:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137906.537042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137906.537260:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460480 00000100:00100000:3.0:1783137906.537274:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460480 00000100:00100000:3.0:1783137906.537368:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:3.0:1783137906.537379:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+27:10567:x1869755299460480:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1783137906.537478:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.537502:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.537516:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.537587:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.537595:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.537603:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.538113:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137906.538119:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.538129:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.538146:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:3.0:1783137906.538150:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137906.538155:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137906.538177:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137906.538359:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+27:10567:x1869755299460480:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 979us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137906.538369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:1.0:1783137906.607362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137906.607465:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460608 00000100:00100000:0.0:1783137906.607477:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460608 00000100:00100000:0.0:1783137906.607597:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:0.0:1783137906.607610:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299460608:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1783137906.607639:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137906.607671:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065e23eec/0x4691dfc3d66b792e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922780 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137906.607707:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a48866e, atime: 0x6a48866e, ctime: 0x6a48866e, blocks: 0xb 00010000:00010000:0.0:1783137906.607737:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1783137906.607742:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137906.607755:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065e23eec/0x4691dfc3d66b792e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922780 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.607780:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065e23eec/0x4691dfc3d66b792e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922780 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137906.607797:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dc0031200, rc 0) 00000100:00100000:0.0:1783137906.607885:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299460608:12345-192.168.202.24@tcp:101:cat.0 Request processed in 278us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137906.607893:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00080000:2.0:1783137906.607967:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137906.611964:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137906.612128:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460736 00000100:00100000:0.0:1783137906.612145:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460736 00002000:00100000:0.0:1783137906.612237:0:6621:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e5dd0a7b800 x1869755299460736/t0(0) o3->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:57/0 lens 488/0 e 0 to 0 dl 1783137917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137906.612274:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dd0a7b800 with x1869755299460736 ext(0->4095) 00002000:00010000:0.0:1783137906.612282:0:6621:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5dd0a7b800 00000100:00100000:0.0:1783137906.612355:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:0.0:1783137906.612368:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299460736:12345-192.168.202.24@tcp:3:cat.0 00000100:00100000:0.0:1783137906.613031:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299460736:12345-192.168.202.24@tcp:3:cat.0 Request processed in 661us (1083us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783137906.613042:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00002000:00100000:0.0:1783137906.613051:0:6621:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e5dd0a7b800 x1869755299460736/t0(0) o3->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:57/0 lens 488/4536 e 0 to 0 dl 1783137917 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137906.613060:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dd0a7b800 with x1869755299460736 ext(0->4095) 00002000:00010000:0.0:1783137906.613064:0:6621:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5dd0a7b800 00010000:00010000:2.0:1783137907.195123:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137907.494935:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1783137907.494963:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1783137907.815683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137907.815723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137907.815757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137907.815775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137907.815799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137907.815844:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461248 00000100:00100000:3.0:1783137907.815857:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461248 00000100:00100000:3.0:1783137907.815921:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461120 00000100:00100000:3.0:1783137907.815925:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461120 00000100:00100000:3.0:1783137907.815965:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1783137907.815978:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299461248:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137907.816085:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299461248:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137907.816093:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1783137907.816113:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:3.0:1783137907.816119:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299461120:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137907.816144:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299461120:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137907.816150:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:3.0:1783137907.816180:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460864 00000100:00100000:3.0:1783137907.816184:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460864 00000100:00100000:3.0:1783137907.816223:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:3.0:1783137907.816229:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299460864:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137907.816258:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2352:x1869755299460864:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137907.816265:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 296 00000100:00100000:2.0:1783137907.816717:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299460992 00000100:00100000:2.0:1783137907.816722:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299460992 00000100:00100000:2.0:1783137907.816764:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461376 00000100:00100000:2.0:1783137907.816767:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461376 00000100:00100000:2.0:1783137907.816796:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:2.0:1783137907.816804:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+27:2352:x1869755299460992:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137907.816854:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+27:2352:x1869755299460992:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 52us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137907.816861:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:2.0:1783137907.816876:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:2.0:1783137907.816882:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299461376:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137907.816907:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2352:x1869755299461376:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137907.816913:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00080000:2.0:1783137907.816932:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137907.816944:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137908.219837:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137908.414463:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137908.414493:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322541952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137908.414614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137908.414986:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322541952 00000100:00100000:1.0:1783137908.414997:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322541952 00000100:00100000:1.0:1783137908.415079:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137908.415106:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322541952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137908.415151:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137908.415223:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322541952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137908.415231:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137908.415274:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783137908.415281:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1783137908.415309:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5e01430e00, transno 4294967304 00000100:00100000:1.0:1783137908.415330:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322541952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137908.415800:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1783137909.181979:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137909.181996:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137909.182039:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783137909.182051:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783137909.242828:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137910.082592:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1783137910.082629:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5dd12ab9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1783137910.082635:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5e0145fe00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dd12abcc0 00000020:00080000:0.0:1783137910.082640:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5e0145f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dfa608800 00000020:00080000:0.0:1783137910.082678:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1783137910.082723:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783137910.082969:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1783137910.104700:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1783137910.104721:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1783137910.104731:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1783137910.272089:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137910.463011:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322542080:0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.463011:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542464:0@lo:400:kworker.0 00000100:00100000:2.0:1783137910.463094:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322542336:0@lo:400:kworker.0 00000100:00100000:1.0:1783137910.463148:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc4206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322542208:0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.467458:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137910.467630:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542464 00000100:00100000:0.0:1783137910.467642:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542464 00000100:00100000:0.0:1783137910.467742:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137910.467758:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.467838:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542464:12345-0@lo:400:kworker.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137910.467846:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1783137910.467871:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137910.467916:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542464:0@lo:400:kworker.0 00000100:00100000:3.0:1783137910.473478:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137910.473575:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322542592:0@lo:400:kworker.0 00000100:00100000:3.0:1783137910.473628:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137910.473702:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542592 00000100:00100000:3.0:1783137910.473712:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542592 00000100:00100000:3.0:1783137910.473788:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783137910.473799:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322542592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137910.473871:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322542592:12345-0@lo:400:kworker.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137910.473879:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783137910.473932:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322542592:0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.477238:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542080 00000100:00100000:0.0:1783137910.477260:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542080 00000100:00100000:0.0:1783137910.477359:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1783137910.477372:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322542080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.477519:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322542080:12345-0@lo:400:kworker.0 Request processed in 150us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137910.477527:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1783137910.477593:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137910.477637:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322542080:0@lo:400:kworker.0 00000100:00100000:2.0:1783137910.480654:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137910.484369:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542336 00000100:00100000:3.0:1783137910.484390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542336 00000100:00100000:1.0:1783137910.484451:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783137910.484511:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137910.484518:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322542720:0@lo:400:kworker.0 00000100:00100000:1.0:1783137910.484587:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137910.484952:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542720 00000100:00100000:0.0:1783137910.484958:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542720 00000100:00100000:0.0:1783137910.485020:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137910.485034:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322542720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.485131:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322542720:12345-0@lo:400:kworker.0 Request processed in 101us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137910.485140:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137910.485207:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1783137910.485215:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5dff97a300, transno 4294967310 00000004:00080000:0.0:1783137910.485229:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1783137910.485257:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322542720:0@lo:400:kworker.0 00000100:00080000:1.0:1783137910.485571:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137910.487886:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542208 00000100:00100000:3.0:1783137910.487906:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542208 00000100:00100000:3.0:1783137910.487997:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783137910.488011:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322542336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137910.488148:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322542336:12345-0@lo:400:kworker.0 Request processed in 141us (7505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137910.488156:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783137910.488188:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783137910.488196:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322542208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137910.488238:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322542208:12345-0@lo:400:kworker.0 Request processed in 43us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137910.488244:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783137910.488460:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322542336:0@lo:400:kworker.0 00000100:00100000:1.0:1783137910.492856:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc4206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322542208:0@lo:400:kworker.0 00000100:00100000:0.0:1783137910.972012:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137910.972045:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd8030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137910.972148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137910.972260:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542848 00000100:00100000:0.0:1783137910.972270:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542848 00000100:00100000:0.0:1783137910.972337:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137910.972349:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137910.972402:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137910.972455:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137910.972463:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137910.972524:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd8030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542848:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137911.290992:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137912.315475:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137912.537761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137912.537818:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461504 00000100:00100000:3.0:1783137912.537832:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461504 00000100:00100000:3.0:1783137912.537929:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:3.0:1783137912.537943:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+14:10219:x1869755299461504:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783137912.538075:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+14:10219:x1869755299461504:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137912.538084:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00080000:1.0:1783137912.538335:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137912.553902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137912.554026:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461760 00000100:00100000:0.0:1783137912.554042:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461760 00000100:00100000:0.0:1783137912.554123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:0.0:1783137912.554136:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+14:10219:x1869755299461760:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137912.554844:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:10219:x1869755299461760:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 707us (953us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1783137912.554862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:3.0:1783137912.825385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137912.825858:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299461888 00000100:00100000:1.0:1783137912.825873:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299461888 00000100:00100000:1.0:1783137912.825991:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:1.0:1783137912.826004:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:11019:x1869755299461888:12345-192.168.202.24@tcp:101:lsof.0 00010000:00010000:1.0:1783137912.826034:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137912.826065:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922787 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826170:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826189:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826204:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137912.826531:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783137912.826536:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137912.826715:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826750:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826771:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137912.826795:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:1.0:1783137912.826798:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137912.826803:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c200, rc 0) 00000100:00100000:1.0:1783137912.826892:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+6:11019:x1869755299461888:12345-192.168.202.24@tcp:101:lsof.0 Request processed in 891us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137912.826901:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00080000:2.0:1783137912.827038:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137912.930117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137912.930435:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462144 00000100:00100000:0.0:1783137912.930451:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462144 00000100:00100000:0.0:1783137912.930597:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00100000:0.0:1783137912.930612:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299462144:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137912.933188:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299462144:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 2561us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137912.933206:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92 00000100:00080000:2.0:1783137912.934099:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137912.936925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137912.936988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137912.937116:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462272 00000100:00100000:1.0:1783137912.937141:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462272 00000100:00100000:1.0:1783137912.937256:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:1.0:1783137912.937273:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299462272:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137912.937381:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299462272:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 113us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137912.937391:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00080000:2.0:1783137912.937786:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137912.938795:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462016 00000100:00100000:0.0:1783137912.938810:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462016 00000100:00100000:0.0:1783137912.938884:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 298 00000100:00100000:0.0:1783137912.938895:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299462016:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137912.938985:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299462016:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137912.938994:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 298 00010000:00010000:1.0:1783137913.338874:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137913.531056:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137913.531171:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137913.531917:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322542976 00000100:00100000:1.0:1783137913.531929:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322542976 00000100:00100000:1.0:1783137913.532019:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137913.532030:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137913.532076:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137913.532154:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322542976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137913.532161:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137913.532215:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322542976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783137913.532335:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783137914.364122:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137915.179512:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1783137915.179579:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783137915.179666:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783137915.179682:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1783137915.388538:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137915.579172:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322543232:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137915.579377:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322543744:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137915.579453:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783137915.579460:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322543104:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579498:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137915.579519:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322543616:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579572:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137915.579602:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322543488:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137915.579646:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137915.579652:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322543360:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.579671:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137915.579918:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543744 00000100:00100000:0.0:1783137915.579929:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543744 00000100:00100000:3.0:1783137915.579938:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543104 00000100:00100000:3.0:1783137915.579942:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543104 00000100:00100000:0.0:1783137915.579988:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543488 00000100:00100000:0.0:1783137915.579992:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543488 00000100:00100000:3.0:1783137915.580004:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783137915.580025:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322543104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137915.580026:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783137915.580032:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322543744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137915.580098:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322543744:12345-0@lo:400:kworker.0 Request processed in 64us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137915.580106:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783137915.580134:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783137915.580142:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322543488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137915.580163:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322543104:12345-0@lo:400:kworker.0 Request processed in 140us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137915.580170:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1783137915.580171:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322543488:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137915.580177:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783137915.580203:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543232 00000100:00100000:3.0:1783137915.580207:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543232 00000100:00080000:1.0:1783137915.580234:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137915.580240:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137915.580280:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322543488:0@lo:400:kworker.0 00000100:00100000:3.0:1783137915.580306:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543616 00000100:00100000:1.0:1783137915.580308:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543360 00000100:00100000:3.0:1783137915.580309:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543616 00000100:00100000:1.0:1783137915.580310:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543360 00000100:00100000:2.0:1783137915.580442:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783137915.580454:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322543232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137915.580496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322543232:12345-0@lo:400:kworker.0 Request processed in 46us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137915.580502:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783137915.589782:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322543104:0@lo:400:kworker.0 00000100:00100000:0.0:1783137915.589829:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322543232:0@lo:400:kworker.0 00000100:00100000:0.0:1783137915.589847:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322543744:0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.600361:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783137915.600383:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322543360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137915.600570:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322543360:12345-0@lo:400:kworker.0 Request processed in 192us (20895us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137915.600579:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783137915.600657:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322543360:0@lo:400:kworker.0 00000100:00080000:1.0:1783137915.600742:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137915.602854:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137915.602887:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322543616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137915.603006:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322543616:12345-0@lo:400:kworker.0 Request processed in 137us (23432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137915.603015:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783137915.604015:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322543616:0@lo:400:kworker.0 00000100:00100000:1.0:1783137916.092829:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137916.092872:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322543872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137916.092996:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137916.093413:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322543872 00000100:00100000:0.0:1783137916.093427:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322543872 00000100:00100000:0.0:1783137916.093516:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783137916.093529:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322543872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137916.093624:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137916.093703:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322543872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137916.093712:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783137916.093945:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322543872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137916.413379:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137917.443026:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137917.498926:0:12194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:05:14 (1783137914) 00000100:00100000:3.0:1783137918.059486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137918.059601:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137918.059643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137918.059687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137918.059716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137918.059935:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462528 00000100:00100000:0.0:1783137918.059949:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462528 00000100:00100000:0.0:1783137918.060034:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462912 00000100:00100000:0.0:1783137918.060038:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462912 00000100:00100000:0.0:1783137918.060065:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:0.0:1783137918.060096:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+14:2350:x1869755299462528:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137918.060225:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+14:2350:x1869755299462528:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 132us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137918.060234:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:0.0:1783137918.060261:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00100000:0.0:1783137918.060268:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2350:x1869755299462912:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137918.060296:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2350:x1869755299462912:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137918.060302:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00080000:3.0:1783137918.060480:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137918.060835:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462784 00000100:00100000:1.0:1783137918.060842:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462784 00000100:00100000:1.0:1783137918.060898:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462656 00000100:00100000:1.0:1783137918.060902:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462656 00000100:00100000:1.0:1783137918.060933:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:1.0:1783137918.060940:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299462784:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137918.060979:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299462784:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 40us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137918.060997:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:1.0:1783137918.061013:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:1.0:1783137918.061020:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299462656:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137918.061044:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2350:x1869755299462656:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 25us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137918.061048:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:2.0:1783137918.061487:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299462400 00000100:00100000:2.0:1783137918.061494:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299462400 00000100:00100000:2.0:1783137918.061577:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 300 00000100:00100000:2.0:1783137918.061585:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299462400:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137918.061618:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2350:x1869755299462400:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137918.061624:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 300 00000100:00080000:3.0:1783137918.062173:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137918.062179:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783137918.459772:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137918.653136:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137918.653169:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322544000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137918.653314:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137918.655510:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544000 00000100:00100000:0.0:1783137918.655529:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544000 00000100:00100000:0.0:1783137918.655752:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137918.655765:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322544000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137918.655821:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137918.655935:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322544000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137918.655943:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137918.656407:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322544000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783137918.659335:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137918.831697:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137918.831862:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463168 00000100:00100000:2.0:1783137918.831876:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463168 00000100:00100000:2.0:1783137918.831955:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:2.0:1783137918.831967:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+14:11284:x1869755299463168:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137918.831993:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137918.832020:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7943 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392278e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832126:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832145:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832160:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832175:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832182:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.832188:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.834007:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7958 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.834051:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7958 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.834065:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7958 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137918.834082:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783137918.836822:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.838817:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839094:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839489:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137918.839496:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839508:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839531:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5dcc9ec200) 00010000:00010000:2.0:1783137918.839534:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137918.839539:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839577:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b794a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839603:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839633:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839640:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839645:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137918.839647:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839654:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839662:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e5de2d1cd00) 00010000:00010000:2.0:1783137918.839665:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137918.839668:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.839675:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7951 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.845876:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7943 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392278e expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.845918:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7958 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392278e expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137918.845929:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:2.0:1783137918.845933:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137918.845952:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3de00, rc 0) 00000100:00100000:2.0:1783137918.846063:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+16:11284:x1869755299463168:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 14097us (14379us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783137918.846074:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:2.0:1783137918.860686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137918.860729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137918.860811:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463296 00000100:00100000:0.0:1783137918.860829:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463296 00000100:00100000:3.0:1783137918.861033:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463424 00000100:00100000:3.0:1783137918.861045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463424 00000100:00100000:0.0:1783137918.861066:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:0.0:1783137918.861083:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+17:11284:x1869755299463296:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783137918.861137:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783137918.861151:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+17:2353:x1869755299463424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137918.861168:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137918.861204:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7958 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392278e expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137918.861247:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137918.861253:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137918.861282:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+16:11284:x1869755299463296:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 200us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137918.861291:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:3.0:1783137918.861315:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+16:2353:x1869755299463424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 164us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137918.861330:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000040:00080000:2.0:1783137919.420532:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137919.420564:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137919.421124:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1783137919.421137:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783137919.482743:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137920.272624:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1783137920.515698:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137920.702630:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137920.702655:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322544384:0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.702730:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137920.702803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544384 00000100:00100000:1.0:1783137920.702810:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544384 00000100:00100000:1.0:1783137920.702863:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783137920.702873:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322544384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.702942:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322544384:12345-0@lo:400:kworker.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137920.702949:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783137920.702992:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322544384:0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.703028:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322544512:0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.703055:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137920.703096:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544512 00000100:00100000:1.0:1783137920.703100:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544512 00000100:00100000:1.0:1783137920.703129:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783137920.703137:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322544512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.703172:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322544512:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137920.703177:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783137920.703328:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322544256:0@lo:400:kworker.0 00000100:00100000:2.0:1783137920.703359:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137920.703380:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137920.703386:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb0a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322544128:0@lo:400:kworker.0 00000100:00100000:2.0:1783137920.703416:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137920.703448:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544256 00000100:00100000:2.0:1783137920.703452:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544256 00000100:00100000:2.0:1783137920.703481:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783137920.703487:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322544256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137920.703518:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322544256:12345-0@lo:400:kworker.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137920.703523:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783137920.703539:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544128 00000100:00100000:2.0:1783137920.703564:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544128 00000100:00100000:2.0:1783137920.703589:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1783137920.703595:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322544128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137920.703623:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322544128:12345-0@lo:400:kworker.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137920.703637:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1783137920.703677:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb0a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322544128:0@lo:400:kworker.0 00000100:00100000:2.0:1783137920.703688:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322544256:0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.703799:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322544512:0@lo:400:kworker.0 00000100:00100000:3.0:1783137920.704383:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322544640:0@lo:400:kworker.0 00000100:00100000:3.0:1783137920.704418:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137920.704441:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137920.704447:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322544768:0@lo:400:kworker.0 00000100:00100000:3.0:1783137920.704470:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783137920.704495:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137920.704500:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137920.704509:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544768 00000100:00100000:3.0:1783137920.704513:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544768 00000100:00100000:3.0:1783137920.704568:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137920.704576:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322544768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137920.704613:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322544768:12345-0@lo:400:kworker.0 Request processed in 38us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137920.704620:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1783137920.704637:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137920.704654:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322544768:0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.704920:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544640 00000100:00100000:1.0:1783137920.704924:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544640 00000100:00100000:1.0:1783137920.704970:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783137920.704978:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322544640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137920.705018:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322544640:12345-0@lo:400:kworker.0 Request processed in 41us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137920.705024:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1783137920.705308:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137920.705329:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322544640:0@lo:400:kworker.0 00000100:00100000:2.0:1783137921.210923:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322544896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137921.211003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137921.211152:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322544896 00000100:00100000:0.0:1783137921.211163:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322544896 00000100:00100000:0.0:1783137921.211236:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783137921.211247:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322544896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137921.211287:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137921.211340:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322544896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137921.211348:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783137921.211407:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322544896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137921.531154:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137921.754351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137921.754743:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463552 00000100:00100000:2.0:1783137921.754753:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463552 00000100:00100000:2.0:1783137921.754896:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:2.0:1783137921.754910:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+14:11327:x1869755299463552:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137921.754933:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137921.754959:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922795 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755041:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755060:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755082:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755099:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755106:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755136:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755441:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755463:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755470:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755476:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137921.755481:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755488:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755500:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:2.0:1783137921.755504:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137921.755509:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755515:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b796d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755529:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755536:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755577:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755583:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137921.755587:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755594:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755602:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e5de2d1c400) 00010000:00010000:2.0:1783137921.755605:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137921.755608:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755615:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755647:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7966 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922795 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755658:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:2.0:1783137921.755660:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137921.755663:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922795 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.755671:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d000, rc 0) 00000100:00100000:2.0:1783137921.755734:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+14:11327:x1869755299463552:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 828us (1392us total) trans 0 rc 301/301 00000100:00100000:2.0:1783137921.755750:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00080000:3.0:1783137921.757427:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137921.768838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137921.769763:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463808 00000100:00100000:0.0:1783137921.769775:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463808 00000100:00100000:0.0:1783137921.769840:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 140 00000100:00100000:0.0:1783137921.769860:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+14:11327:x1869755299463808:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:0.0:1783137921.769918:0:11954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137921.769947:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b72e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ce expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137921.769969:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:0.0:1783137921.769975:0:11954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137921.770314:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137921.770330:0:11954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137921.770339:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137921.770382:0:11954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137921.770396:0:11954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 5 pid: 5812 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137921.770411:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322545024:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137921.770508:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137921.776246:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322545024:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137921.776295:0:11954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137921.790633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137921.791160:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299463936 00000100:00100000:2.0:1783137921.791171:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299463936 00010000:00010000:2.0:1783137921.791232:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 6 pid: 5812 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137921.791267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1783137921.791276:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2351:x1869755299463936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137921.791292:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137921.791301:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 6 pid: 5812 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791314:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 6 pid: 5812 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791338:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b793c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922787 expref: 6 pid: 5812 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791354:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:2.0:1783137921.791358:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791366:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791373:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137921.791422:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1783137921.791671:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137921.792114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299463936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 835us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137921.792122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00010000:00010000:1.0:1783137921.795597:0:11954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.795619:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.795656:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.795670:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.795682:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137921.800085:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783137921.800317:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800329:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800336:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800341:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137921.800354:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800363:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800384:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dc39a2800) 00010000:00010000:1.0:1783137921.800387:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137921.800392:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137921.800397:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b797b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137921.800421:0:11954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a234af82 reply state 000000008ed42903 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137921.800430:0:11954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137921.800951:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+15:11327:x1869755299463808:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 31087us (32117us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783137921.800961:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 140 00010000:00010000:3.0:1783137921.815941:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.815961:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.815970:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.815976:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137921.815981:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.815989:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.816007:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e5dc5113600) 00010000:00010000:3.0:1783137921.816010:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137921.816014:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137921.816020:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7982 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.009268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.009373:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464064 00000100:00100000:2.0:1783137922.009383:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464064 00000100:00100000:2.0:1783137922.009448:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:2.0:1783137922.009460:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+14:11335:x1869755299464064:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:2.0:1783137922.009487:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137922.009510:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392279c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009600:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009615:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009627:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137922.009728:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783137922.009732:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137922.009757:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009777:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392279c expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009811:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392279c expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.009817:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:2.0:1783137922.009820:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137922.009822:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3ca00, rc 0) 00000100:00100000:2.0:1783137922.009871:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+15:11335:x1869755299464064:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 415us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137922.009876:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:2.0:1783137922.141673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.141974:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464192 00000100:00100000:0.0:1783137922.141984:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464192 00000100:00100000:0.0:1783137922.142060:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:0.0:1783137922.142082:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+15:11341:x1869755299464192:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137922.142111:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137922.142143:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227a3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142214:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142228:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142240:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142255:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142281:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142288:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142839:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142850:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142857:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137922.142892:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783137922.142896:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137922.142921:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142933:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142939:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142945:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142951:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137922.142955:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142970:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142983:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:0.0:1783137922.142986:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137922.142990:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.142996:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b799e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143024:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143030:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143035:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143041:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137922.143044:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143049:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143056:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e5dcc9ecb00) 00010000:00010000:0.0:1783137922.143059:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137922.143061:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143088:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143299:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227a3 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143314:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227a3 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.143320:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137922.143322:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783137922.143324:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045800, rc 0) 00000100:00100000:0.0:1783137922.143400:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+16:11341:x1869755299464192:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1330us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137922.143407:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:3.0:1783137922.146711:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.146850:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464448 00000100:00100000:1.0:1783137922.146860:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464448 00000100:00100000:1.0:1783137922.146926:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:1.0:1783137922.146936:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+16:11341:x1869755299464448:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137922.146959:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137922.146980:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b79b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227aa expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147303:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147319:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147330:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147384:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147391:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.147397:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137922.149010:0:11954:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783137922.149442:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149457:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149469:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149506:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149527:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149534:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.149539:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137922.151272:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.151290:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.151307:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137922.151310:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137922.151316:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.151322:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b79ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137922.151339:0:11954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3f66d28 reply state 00000000f5382d82 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.151347:0:11954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783137922.151396:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b79b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 19 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.151410:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 18 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.151438:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:1.0:1783137922.151440:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137922.151443:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c200, rc 0) 00000100:00100000:1.0:1783137922.151519:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+19:11341:x1869755299464448:12345-192.168.202.24@tcp:101:bash.0 Request processed in 4583us (4818us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1783137922.151528:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 143 00010000:00010000:3.0:1783137922.163338:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163360:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163369:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163394:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137922.163399:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163408:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163429:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113100) 00010000:00010000:3.0:1783137922.163433:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137922.163437:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.163444:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b79c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137922.172699:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.172910:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464576 00000100:00100000:1.0:1783137922.172921:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464576 00000100:00100000:1.0:1783137922.172997:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1783137922.173007:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2352:x1869755299464576:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137922.173034:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137922.173054:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227b1 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137922.173101:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783137922.173129:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1783137922.173133:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137922.173143:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 6 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.173161:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 6 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.173173:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6ce00, rc 0) 00000100:00080000:3.0:1783137922.173222:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137922.173241:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299464576:12345-192.168.202.24@tcp:101:bash.0 Request processed in 234us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137922.173264:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1783137922.187907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137922.188044:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464704 00000100:00100000:3.0:1783137922.188054:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464704 00000100:00100000:3.0:1783137922.188161:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:3.0:1783137922.188172:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:11341:x1869755299464704:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783137922.188192:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137922.188209:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227b8 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.188241:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 7 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.188251:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137922.188270:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137922.188277:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.188309:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 7 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.188324:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 7 pid: 6615 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.188337:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322545152:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137922.188428:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137922.195510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.195699:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299464832 00000100:00100000:2.0:1783137922.195709:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299464832 00010000:00010000:2.0:1783137922.195753:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 8 pid: 6615 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137922.195803:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:2.0:1783137922.195813:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299464832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137922.195827:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137922.195850:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 8 pid: 6615 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.195865:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 8 pid: 6615 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.195907:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137922.195912:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137922.195921:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.195932:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.195970:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137922.195985:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322545280:192.168.202.24@tcp:105: 00000100:00100000:2.0:1783137922.196061:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181840 going to sleep for 11 seconds 00010000:00010000:3.0:1783137922.196577:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5ca3951/0x4691dfc3d66b79d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b1 expref: 8 pid: 6615 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.196605:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6617:1869755322545152:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137922.196629:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.196639:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7800, rc 0) 00000100:00100000:3.0:1783137922.196671:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:11341:x1869755299464704:12345-192.168.202.24@tcp:101:bash.0 Request processed in 8502us (8775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137922.196678:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:2.0:1783137922.205972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.207021:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299465088 00000100:00100000:0.0:1783137922.207033:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299465088 00000100:00100000:0.0:1783137922.207113:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1783137922.207132:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+18:11341:x1869755299465088:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1783137922.207494:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11341:x1869755299465088:12345-192.168.202.24@tcp:35:bash.0 Request processed in 363us (1531us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783137922.207502:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1783137922.207879:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322545280:192.168.202.24@tcp:105: 00010000:00010000:3.0:1783137922.207905:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137922.207946:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299464832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 12134us (12446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137922.207954:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:1.0:1783137922.358008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.359105:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299465344 00000100:00100000:2.0:1783137922.359118:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299465344 00000100:00100000:2.0:1783137922.359191:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:2.0:1783137922.359202:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:11351:x1869755299465344:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137922.359229:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137922.359249:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b79e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227bf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137922.359374:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783137922.359493:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b79e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227bf expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.359526:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:2.0:1783137922.359529:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137922.359534:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b79e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227bf expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.359579:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c200, rc 0) 00000100:00100000:2.0:1783137922.359792:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11351:x1869755299465344:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 591us (1796us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1783137922.359799:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:1.0:1783137922.374034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.374156:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299465600 00000100:00100000:0.0:1783137922.374167:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299465600 00000100:00100000:0.0:1783137922.374238:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:0.0:1783137922.374265:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:11351:x1869755299465600:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137922.374571:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:11351:x1869755299465600:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 281us (519us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783137922.374580:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:2.0:1783137922.555139:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.555988:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299465728 00000100:00100000:0.0:1783137922.556000:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299465728 00000100:00100000:0.0:1783137922.556062:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 145 00000100:00100000:0.0:1783137922.556082:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:11357:x1869755299465728:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137922.556106:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137922.556125:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227c6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556197:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556211:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556222:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137922.556283:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783137922.556287:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137922.556311:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556347:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b79f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227c6 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556387:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227c6 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.556395:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137922.556398:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137922.556401:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045400, rc 0) 00000100:00100000:0.0:1783137922.556466:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:11357:x1869755299465728:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 386us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137922.556472:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 145 00010000:00010000:1.0:1783137922.558511:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137922.571588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.571700:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299465984 00000100:00100000:2.0:1783137922.571710:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299465984 00000100:00100000:2.0:1783137922.571773:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:2.0:1783137922.571785:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+22:11357:x1869755299465984:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137922.571806:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137922.571826:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227cd expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.571946:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.571961:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.571972:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137922.572006:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783137922.572185:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227cd expref: 25 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.572205:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227cd expref: 24 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.572214:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:2.0:1783137922.572216:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137922.572219:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d200, rc 0) 00000100:00100000:2.0:1783137922.572287:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+24:11357:x1869755299465984:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 504us (709us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783137922.572294:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:3.0:1783137922.579478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137922.579525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.579641:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299466240 00000100:00100000:1.0:1783137922.579651:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299466240 00000100:00100000:1.0:1783137922.579715:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:1.0:1783137922.579724:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+24:11357:x1869755299466240:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137922.579749:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137922.579773:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227d4 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.579894:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.579909:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.579921:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137922.579934:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783137922.580062:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227d4 expref: 27 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.580094:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227d4 expref: 26 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.580118:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:1.0:1783137922.580121:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783137922.580124:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6ca00, rc 0) 00000100:00100000:1.0:1783137922.580199:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+26:11357:x1869755299466240:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 476us (732us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783137922.580207:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:2.0:1783137922.580713:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299466368 00000100:00100000:2.0:1783137922.580719:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299466368 00000100:00100000:2.0:1783137922.580764:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783137922.580772:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:2352:x1869755299466368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137922.580783:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137922.580797:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227cd expref: 26 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.580809:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:2.0:1783137922.580812:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137922.580848:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+25:2352:x1869755299466368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137922.580855:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1783137922.588597:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.588738:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299466496 00000100:00100000:1.0:1783137922.588750:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299466496 00000100:00100000:1.0:1783137922.588799:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1783137922.588809:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+6:2350:x1869755299466496:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:1.0:1783137922.588873:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.588894:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.588904:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137922.588908:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137922.588912:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.588951:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 6 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.588965:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 6 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.588994:0:6615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6615:1869755322545408:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137922.589106:0:6615:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd1394e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137922.602425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.602604:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299466624 00000100:00100000:2.0:1783137922.602614:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299466624 00002000:00100000:2.0:1783137922.602677:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e5df5bed180 x1869755299466624/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:73/0 lens 504/0 e 0 to 0 dl 1783137933 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137922.602689:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5bed180 with x1869755299466624 ext(0->12) 00010000:00010000:2.0:1783137922.602698:0:6620:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 7 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.602714:0:6620:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 7 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137922.602721:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5df5bed180 00000100:00100000:2.0:1783137922.602760:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1783137922.602770:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299466624:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:2.0:1783137922.603342:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299466624:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 573us (927us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783137922.603351:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00002000:00100000:2.0:1783137922.603358:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e5df5bed180 x1869755299466624/t4294967305(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:73/0 lens 504/448 e 0 to 0 dl 1783137933 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137922.603367:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5bed180 with x1869755299466624 ext(0->12) 00010000:00010000:2.0:1783137922.603373:0:6620:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.603387:0:6620:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137922.603406:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5df5bed180 00000100:00100000:1.0:1783137922.603872:0:6615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0110f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6615:1869755322545408:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137922.603898:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.611608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.611716:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299466752 00000100:00100000:0.0:1783137922.611727:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299466752 00010000:00010000:0.0:1783137922.611767:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137922.611812:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:0.0:1783137922.611822:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2350:x1869755299466752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137922.611853:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783137922.611873:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783137922.611877:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783137921 00002000:00010000:0.0:1783137922.611879:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783137921 00002000:00010000:0.0:1783137922.611881:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783137921 00010000:00010000:0.0:1783137922.611887:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.611901:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.611940:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a6c957/0x4691dfc3d66b79dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227b8 expref: 9 pid: 6617 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.611958:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137922.611963:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137922.611969:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.611980:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.612016:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137922.612095:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2350:x1869755299466752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 274us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137922.612103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00010000:00010000:1.0:1783137922.612235:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612245:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612270:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612279:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612286:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612292:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137922.612297:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612318:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612331:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.612339:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc43754/0x4691dfc3d66b7a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.612387:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2350:x1869755299466496:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 23579us (23800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137922.612394:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1783137922.625112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.625407:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467008 00000100:00100000:0.0:1783137922.625419:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467008 00000100:00100000:0.0:1783137922.625489:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:0.0:1783137922.625499:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6706c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+25:11357:x1869755299467008:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:0.0:1783137922.625609:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227d4 expref: 25 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137922.625885:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1783137922.625933:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1783137922.627649:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1783137922.627742:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.627761:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 29 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.627771:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.627809:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 29 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.627825:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 29 pid: 11954 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.628235:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322545536:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137922.628387:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14acb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137922.638298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.638452:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467136 00000100:00100000:0.0:1783137922.638462:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467136 00010000:00010000:0.0:1783137922.638513:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 30 pid: 11954 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137922.638588:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:0.0:1783137922.638599:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+30:2352:x1869755299467136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137922.638633:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137922.638641:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 30 pid: 11954 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.638655:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 30 pid: 11954 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.638682:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:0.0:1783137922.638688:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.638698:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.638706:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137922.638727:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137922.638776:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+30:2352:x1869755299467136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 178us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137922.638784:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00010000:00010000:3.0:1783137922.639025:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c200/0x4691dfc3d66b79c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227aa expref: 29 pid: 11954 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.639054:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322545536:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137922.639085:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.639096:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.639102:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137922.639251:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783137922.639460:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1783137922.639603:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322545664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137922.639698:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137922.639721:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137922.640063:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322545664 00000100:00100000:0.0:1783137922.640079:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322545664 00000100:00100000:0.0:1783137922.640131:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137922.640149:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322545664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137922.640231:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322545664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137922.640238:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783137922.641800:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137922.643016:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb060700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322545664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137922.647674:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1783137922.647776:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322545792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137922.647860:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137922.647893:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137922.653639:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322545792 00000100:00100000:0.0:1783137922.653656:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322545792 00000100:00100000:0.0:1783137922.653731:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137922.653742:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322545792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137922.654025:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1869755322545792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 284us (6164us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783137922.654033:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137922.654374:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322545792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137922.654448:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1783137922.654489:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654500:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654520:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654526:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137922.654531:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654538:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654588:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:3.0:1783137922.654591:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783137922.654595:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.654601:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7a31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137922.654780:0:5814:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783137922.654880:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1783137922.654890:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412547344477ns, next at 413547342943ns, rc = 0 00000001:00080000:3.0:1783137922.654895:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1783137922.654922:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113c00) 00010000:00010000:3.0:1783137922.654925:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783137922.654931:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227d4 expref: 33 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137922.655014:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6706c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:11357:x1869755299467008:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 29516us (29913us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1783137922.655030:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000020:00080000:3.0:1783137922.655035:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783137922.663830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.664049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467264 00000100:00100000:1.0:1783137922.664060:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467264 00000100:00100000:1.0:1783137922.664130:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1783137922.664140:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+32:11357:x1869755299467264:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137922.664174:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137922.664201:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7a38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.664266:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227db expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.664284:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227db expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.664324:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137922.664328:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137922.664332:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d400, rc 0) 00000100:00100000:1.0:1783137922.664397:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+33:11357:x1869755299467264:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 258us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137922.664405:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1783137922.677521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137922.677650:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467520 00000100:00100000:3.0:1783137922.677660:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467520 00000100:00100000:3.0:1783137922.677706:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137922.677714:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+33:11357:x1869755299467520:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137922.677943:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+34:11357:x1869755299467520:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 228us (431us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1783137922.677950:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:3.0:1783137922.805741:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137922.805795:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467776 00000100:00100000:3.0:1783137922.805805:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467776 00000100:00100000:3.0:1783137922.805864:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:3.0:1783137922.805873:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+34:11367:x1869755299467776:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137922.805896:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137922.805915:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227e2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137922.806029:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783137922.807871:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7a3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e2 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.807893:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:3.0:1783137922.807896:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137922.807901:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e2 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137922.807931:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6600, rc 0) 00000100:00100000:3.0:1783137922.807997:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+35:11367:x1869755299467776:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2124us (2265us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1783137922.808007:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149 00000100:00100000:2.0:1783137922.829688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.829805:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299467904 00000100:00100000:1.0:1783137922.829818:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299467904 00000100:00100000:1.0:1783137922.829889:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:1.0:1783137922.829900:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+35:11367:x1869755299467904:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:1.0:1783137922.829996:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830018:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830032:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830046:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830052:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830058:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830222:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830230:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830237:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137922.830287:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830299:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830306:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830313:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830319:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137922.830323:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830331:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830344:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137922.830348:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137922.830354:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830368:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7a4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830381:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830386:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830391:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830395:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137922.830398:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830404:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830411:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137922.830413:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137922.830416:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830421:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830435:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830440:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830451:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830455:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137922.830458:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830463:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830472:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137922.830475:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137922.830478:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.830483:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.830594:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+35:11367:x1869755299467904:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 694us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137922.830602:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 150 00000100:00100000:3.0:1783137922.835082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137922.835128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299468160 00000100:00100000:3.0:1783137922.835137:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299468160 00000100:00100000:3.0:1783137922.840520:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:3.0:1783137922.840564:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:11367:x1869755299468160:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137922.840876:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:11367:x1869755299468160:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 341us (5813us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1783137922.840884:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000001:00080000:0.0:1783137922.857889:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1783137922.857911:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1783137922.890835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137922.890936:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299468416 00000100:00100000:2.0:1783137922.890947:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299468416 00000100:00100000:2.0:1783137922.891012:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00100000:2.0:1783137922.891024:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+36:11370:x1869755299468416:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137922.891050:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137922.891107:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227e9 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891207:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891232:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891243:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891257:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891264:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891270:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891531:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891540:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891591:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137922.891601:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783137922.891691:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891698:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891705:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891711:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137922.891717:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891724:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891736:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137922.891739:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137922.891742:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891758:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7a69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891772:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891778:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891782:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891788:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137922.891791:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891797:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891804:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1cd00) 00010000:00010000:2.0:1783137922.891807:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137922.891810:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891816:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891856:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 39 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891882:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 38 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137922.891889:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137922.891892:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137922.891894:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d400, rc 0) 00000100:00100000:2.0:1783137922.891961:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+38:11370:x1869755299468416:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 940us (1137us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1783137922.891969:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 151 00000100:00100000:2.0:1783137922.898415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137922.898693:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299468544 00000100:00100000:1.0:1783137922.898705:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299468544 00000100:00100000:1.0:1783137922.898770:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00100000:1.0:1783137922.898781:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+38:11370:x1869755299468544:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:1.0:1783137922.898857:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898894:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898906:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898935:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898942:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898950:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898956:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137922.898960:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898966:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898977:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137922.898980:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137922.898985:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137922.898991:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137922.899074:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+38:11370:x1869755299468544:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 283us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137922.899089:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 152 00000100:00100000:3.0:1783137922.903590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137922.903697:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299468800 00000100:00100000:0.0:1783137922.903706:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299468800 00000100:00100000:0.0:1783137922.903764:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:0.0:1783137922.903774:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+38:11370:x1869755299468800:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137922.903999:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:11370:x1869755299468800:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 226us (455us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783137922.904006:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:3.0:1783137923.178203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.178273:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.178312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.178356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.178404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.178454:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469312 00000100:00100000:3.0:1783137923.178623:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469312 00000100:00100000:3.0:1783137923.178679:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469184 00000100:00100000:3.0:1783137923.178682:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469184 00000100:00100000:3.0:1783137923.178822:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:3.0:1783137923.178833:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299469312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137923.178905:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299469312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 75us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137923.178925:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:3.0:1783137923.178940:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:3.0:1783137923.178946:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299469184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137923.178973:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299469184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137923.178978:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00080000:3.0:1783137923.178995:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137923.179348:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299468928 00000100:00100000:1.0:1783137923.179353:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299468928 00000100:00100000:1.0:1783137923.179418:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 302 00000100:00100000:1.0:1783137923.179426:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299468928:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137923.179457:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299468928:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137923.179661:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 302 00000100:00100000:2.0:1783137923.180204:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469056 00000100:00100000:2.0:1783137923.180210:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469056 00000100:00100000:2.0:1783137923.180257:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469440 00000100:00100000:2.0:1783137923.180261:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469440 00000100:00100000:2.0:1783137923.180295:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:2.0:1783137923.180303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+39:2353:x1869755299469056:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137923.180357:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+39:2353:x1869755299469056:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 54us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137923.180364:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:2.0:1783137923.180396:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:2.0:1783137923.180404:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299469440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137923.180431:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299469440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137923.180437:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00080000:3.0:1783137923.181575:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137923.415900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137923.416012:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469696 00000100:00100000:0.0:1783137923.416023:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469696 00000100:00100000:0.0:1783137923.416097:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 153 00000100:00100000:0.0:1783137923.416108:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:11401:x1869755299469696:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1783137923.416127:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137923.416148:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7a8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227f0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.416286:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7a93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.416301:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.416325:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137923.416337:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783137923.416466:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7a8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f0 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.416486:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7a93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f0 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.416494:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137923.416497:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137923.416500:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044000, rc 0) 00000100:00100000:0.0:1783137923.416614:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+41:11401:x1869755299469696:12345-192.168.202.24@tcp:101:cat.0 Request processed in 508us (724us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783137923.416622:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 153 00000100:00100000:2.0:1783137923.425198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137923.425477:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299469952 00000100:00100000:0.0:1783137923.425487:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299469952 00000100:00100000:0.0:1783137923.425620:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:0.0:1783137923.425631:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+41:11401:x1869755299469952:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1783137923.425915:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+42:11401:x1869755299469952:12345-192.168.202.24@tcp:35:cat.0 Request processed in 285us (727us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783137923.425933:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1783137923.435156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137923.435282:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299470080 00000100:00100000:3.0:1783137923.435292:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299470080 00000100:00100000:3.0:1783137923.435375:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1783137923.435387:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+42:2351:x1869755299470080:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137923.435405:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137923.435433:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7a93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f0 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137923.435457:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:3.0:1783137923.435463:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137923.435527:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+41:2351:x1869755299470080:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137923.435535:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:1.0:1783137923.567894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137923.568224:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299470336 00000100:00100000:2.0:1783137923.568235:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299470336 00000100:00100000:2.0:1783137923.568307:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 154 00000100:00100000:2.0:1783137923.568318:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+41:11407:x1869755299470336:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1783137923.568344:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137923.568346:0:11954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137923.568383:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b79f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227c6 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568408:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137923.568412:0:11954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137923.568426:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7aa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227f7 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568781:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568796:0:11954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 41 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568805:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568838:0:11954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 41 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.568852:0:11954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 41 pid: 11954 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137923.568887:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322545920:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137923.569111:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137923.576427:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322545920:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137923.576471:0:11954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137923.576779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1783137923.578704:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137923.584422:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299470464 00000100:00100000:0.0:1783137923.584442:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299470464 00010000:00010000:0.0:1783137923.584509:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 42 pid: 11954 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137923.584638:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1783137923.584649:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+42:2352:x1869755299470464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137923.584667:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137923.584675:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 42 pid: 11954 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584689:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 42 pid: 11954 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584724:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7a77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227e9 expref: 42 pid: 11954 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584742:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137923.584748:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584757:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584764:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137923.584817:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137923.584890:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+41:2352:x1869755299470464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 243us (8113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137923.584899:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00010000:00010000:2.0:1783137923.584968:0:11954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.584977:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137923.584998:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783137923.586880:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7aa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 42 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.586905:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 41 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.586914:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137923.586916:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137923.586919:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3dc00, rc 0) 00000100:00100000:2.0:1783137923.586977:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+41:11407:x1869755299470336:12345-192.168.202.24@tcp:101:dd.0 Request processed in 18661us (19094us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1783137923.586985:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 154 00000100:00100000:1.0:1783137923.603781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137923.610575:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299470720 00000100:00100000:2.0:1783137923.610606:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299470720 00000100:00100000:2.0:1783137923.610669:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 155 00000100:00100000:2.0:1783137923.610679:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+41:11407:x1869755299470720:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:2.0:1783137923.610933:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.610951:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.610963:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137923.611008:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1783137923.611029:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ae2e7cb reply state 0000000098133288 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137923.611037:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137923.611188:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+44:11407:x1869755299470720:12345-192.168.202.24@tcp:36:dd.0 Request processed in 509us (7417us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783137923.611196:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 155 00000020:00080000:2.0:1783137923.611200:0:7189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137923.617027:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617045:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617053:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617070:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137923.617075:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617099:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617117:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137923.617133:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137923.617138:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137923.617144:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7ab6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137923.770809:0:6762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413663262395ns, next at 414663259602ns, rc = 0 00000100:00100000:0.0:1783137923.770885:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137923.770906:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc877b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322546048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137923.770979:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137923.771172:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322546048 00000100:00100000:2.0:1783137923.771181:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322546048 00000100:00100000:2.0:1783137923.771236:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783137923.771255:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322546048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137923.771279:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1783137923.771332:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322546048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137923.771339:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783137923.771416:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1783137923.771421:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1783137923.771460:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc877b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322546048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137924.207653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137924.207955:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299470848 00000100:00100000:2.0:1783137924.207964:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299470848 00000100:00100000:2.0:1783137924.208015:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:2.0:1783137924.208024:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+43:11421:x1869755299470848:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:2.0:1783137924.208047:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137924.208102:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7abd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239227fe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208174:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208193:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208206:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208219:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208225:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208231:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208319:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208329:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 44 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208337:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208365:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 44 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.208377:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 44 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137924.208401:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322546176:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137924.208495:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137924.224453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137924.233338:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322546176:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137924.233376:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137924.240208:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299471104 00000100:00100000:3.0:1783137924.240227:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299471104 00000100:00100000:3.0:1783137924.240312:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1783137924.240323:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+45:5580:x1869755299471104:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783137924.242902:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:5580:x1869755299471104:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 2571us (18451us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1783137924.242914:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1783137924.246387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137924.246506:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299471232 00000100:00100000:0.0:1783137924.246516:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299471232 00010000:00010000:0.0:1783137924.246594:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 46 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137924.246653:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1783137924.246663:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:2353:x1869755299471232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137924.246677:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137924.246686:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 46 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246700:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 46 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246723:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7aa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227f7 expref: 46 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246760:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137924.246766:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246776:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246783:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.246802:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137924.246861:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+45:2353:x1869755299471232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 198us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137924.246869:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00010000:00010000:1.0:1783137924.251895:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.251913:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137924.251964:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783137924.251968:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137924.251991:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252004:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252033:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252040:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252047:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252064:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137924.252068:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252076:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252091:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137924.252094:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137924.252098:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252105:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7ac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252123:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252129:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252135:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252147:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137924.252150:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252156:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252164:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1cd00) 00010000:00010000:1.0:1783137924.252166:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137924.252169:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252175:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7acb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252221:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7abd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227fe expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252235:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227fe expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.252243:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137924.252245:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137924.252248:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c600, rc 0) 00000100:00100000:1.0:1783137924.252336:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc877b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+44:11421:x1869755299470848:12345-192.168.202.24@tcp:101:stat.0 Request processed in 44311us (44690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137924.252345:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 156 00000100:00100000:3.0:1783137924.462952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137924.463106:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299471488 00000100:00100000:2.0:1783137924.463115:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299471488 00000100:00100000:2.0:1783137924.463184:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 157 00000100:00100000:2.0:1783137924.463195:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+44:11427:x1869755299471488:12345-192.168.202.24@tcp:36:truncate.0 00010000:00010000:2.0:1783137924.463253:0:11954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137924.463280:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7ad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227fe expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.463300:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137924.463304:0:11954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137924.463521:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.463535:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.463880:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137924.463932:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1783137924.463955:0:11954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a0b2278 reply state 000000003216443d transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137924.463976:0:11954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137924.464146:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+46:11427:x1869755299471488:12345-192.168.202.24@tcp:36:truncate.0 Request processed in 952us (1201us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783137924.464154:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 157 00000020:00080000:2.0:1783137924.464159:0:11954:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783137924.477076:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477108:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477116:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477121:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137924.477126:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477133:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477162:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137924.477165:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137924.477170:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.477176:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7ad9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.607594:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137924.772044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137924.772795:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299471616 00000100:00100000:0.0:1783137924.772807:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299471616 00000100:00100000:0.0:1783137924.772873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:0.0:1783137924.772884:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+45:11441:x1869755299471616:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:0.0:1783137924.772910:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137924.772933:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7ae0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922805 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.772999:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.773014:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.773063:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.773079:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.773085:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.773091:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776382:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776404:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776426:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137924.776879:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783137924.776885:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137924.776913:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776927:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776938:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776965:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776972:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776979:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137924.776984:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.776992:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777008:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137924.777012:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137924.777017:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777025:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7ae7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777231:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777247:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777254:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777258:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137924.777267:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777273:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777281:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dcc9ecb00) 00010000:00010000:0.0:1783137924.777284:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137924.777287:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777292:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7aee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777350:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7ae0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 47 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777368:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.777376:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137924.777379:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137924.777381:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045400, rc 0) 00000100:00100000:0.0:1783137924.779045:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+46:11441:x1869755299471616:12345-192.168.202.24@tcp:101:stat.0 Request processed in 6142us (6991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137924.779065:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 158 00000100:00100000:3.0:1783137924.848951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137924.850184:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299471872 00000100:00100000:1.0:1783137924.850202:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299471872 00000100:00100000:1.0:1783137924.850292:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:1.0:1783137924.850303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+46:11451:x1869755299471872:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137924.850325:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137924.850348:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392280c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137924.850722:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783137924.850842:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7afc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392280c expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.850857:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:1.0:1783137924.850860:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137924.850865:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392280c expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.850880:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6de00, rc 0) 00000100:00100000:1.0:1783137924.850958:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+47:11451:x1869755299471872:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 657us (2131us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1783137924.850966:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 159 00000100:00100000:3.0:1783137924.855523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137924.855703:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299472128 00000100:00100000:0.0:1783137924.855715:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299472128 00000100:00100000:0.0:1783137924.855794:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1783137924.855808:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6704050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+47:11451:x1869755299472128:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137924.856403:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6704050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+48:11451:x1869755299472128:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 595us (892us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1783137924.856413:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:3.0:1783137924.964472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137924.964608:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299472384 00000100:00100000:2.0:1783137924.964624:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299472384 00000100:00100000:2.0:1783137924.964697:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00100000:2.0:1783137924.964707:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+48:11457:x1869755299472384:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137924.964744:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137924.964788:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7b0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922813 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.964937:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.964950:0:11954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.964959:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.964994:0:11954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.965004:0:11954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 49 pid: 5811 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137924.965017:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322546304:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137924.965125:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa1810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137924.973086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137924.973248:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299472512 00000100:00100000:3.0:1783137924.973265:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299472512 00010000:00010000:3.0:1783137924.973310:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 50 pid: 5811 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137924.973356:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1783137924.973366:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+50:2352:x1869755299472512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137924.973378:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137924.973383:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 50 pid: 5811 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137924.973394:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 50 pid: 5811 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137924.973427:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:3.0:1783137924.973431:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137924.973438:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137924.973444:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137924.973457:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137924.973505:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+50:2352:x1869755299472512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 141us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137924.973510:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00010000:00010000:2.0:1783137924.973907:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7af5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922805 expref: 49 pid: 5811 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137924.973923:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322546304:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137924.973943:0:11954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.973949:0:11954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.973953:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137924.973968:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783137924.974119:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7b0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 50 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.974134:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 49 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.974141:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137924.974144:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137924.974147:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c400, rc 0) 00000100:00100000:2.0:1783137924.974181:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+49:11457:x1869755299472384:12345-192.168.202.24@tcp:101:bash.0 Request processed in 9477us (9730us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1783137924.974186:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 160 00000100:00100000:1.0:1783137924.977849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137924.977927:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299472768 00000100:00100000:0.0:1783137924.977935:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299472768 00000100:00100000:0.0:1783137924.977979:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:0.0:1783137924.977989:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+49:11457:x1869755299472768:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:0.0:1783137924.978293:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.978312:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.978324:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137924.978377:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1783137924.978402:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006468fc76 reply state 0000000028786a37 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137924.978413:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137924.978506:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:11457:x1869755299472768:12345-192.168.202.24@tcp:36:bash.0 Request processed in 518us (663us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783137924.978514:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 161 00000020:00080000:0.0:1783137924.978519:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783137924.987345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137924.987825:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299472896 00000100:00100000:1.0:1783137924.987834:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299472896 00000100:00100000:1.0:1783137924.987882:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 162 00000100:00100000:1.0:1783137924.987889:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+52:11457:x1869755299472896:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137924.987910:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137924.987925:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392281a expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.987993:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988019:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988025:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988029:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988055:0:7189:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988140:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137924.988158:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137924.988173:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322546432:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137924.988368:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988390:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988397:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988403:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137924.988407:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988414:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988429:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137924.988432:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137924.988435:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988444:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137924.988450:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7b1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137924.988652:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137924.995001:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322546432:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137924.995029:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137924.997263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137924.999235:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299473024 00000100:00100000:0.0:1783137924.999255:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299473024 00010000:00010000:0.0:1783137924.999482:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137924.999651:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:0.0:1783137924.999664:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:2352:x1869755299473024:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137924.999685:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137924.999696:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999712:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999741:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7b11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922813 expref: 53 pid: 11954 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999762:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137924.999768:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999780:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999788:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137924.999824:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137924.999913:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137924.999913:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:2352:x1869755299473024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 249us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137924.999940:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00010000:00010000:1.0:1783137924.999944:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137925.000021:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783137925.000026:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137925.000268:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.000312:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392281a expref: 52 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.000335:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392281a expref: 51 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.000346:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137925.000349:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137925.000353:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c800, rc 0) 00000100:00100000:1.0:1783137925.000438:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+51:11457:x1869755299472896:12345-192.168.202.24@tcp:101:bash.0 Request processed in 12548us (13100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137925.000448:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 162 00000100:00100000:2.0:1783137925.010705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137925.010914:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299473280 00000100:00100000:0.0:1783137925.010947:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299473280 00000100:00080000:3.0:1783137925.013011:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137925.013141:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:2.0:1783137925.013158:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+51:11457:x1869755299473280:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1783137925.013497:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+52:11457:x1869755299473280:12345-192.168.202.24@tcp:35:bash.0 Request processed in 345us (2809us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1783137925.013521:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:3.0:1783137925.141250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137925.141590:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299473536 00000100:00100000:0.0:1783137925.141601:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299473536 00000100:00100000:0.0:1783137925.141672:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:0.0:1783137925.141682:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+52:11467:x1869755299473536:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137925.141706:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137925.145601:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922821 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137925.145944:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783137925.146954:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922821 expref: 54 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.147427:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:0.0:1783137925.147431:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137925.147438:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922821 expref: 54 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.147461:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044e00, rc 0) 00000100:00100000:0.0:1783137925.147656:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+53:11467:x1869755299473536:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 5973us (6424us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1783137925.147666:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 163 00000100:00100000:1.0:1783137925.169598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.169979:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299473664 00000100:00100000:2.0:1783137925.169990:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299473664 00000100:00100000:2.0:1783137925.170099:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00100000:2.0:1783137925.170109:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:11467:x1869755299473664:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:2.0:1783137925.170197:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170213:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170227:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170262:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170270:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170277:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170376:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170385:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.170392:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137925.172061:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172086:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172093:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172100:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172106:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137925.172110:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172119:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172133:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137925.172136:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137925.172140:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172253:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172273:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172279:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172301:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172306:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137925.172309:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172315:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172324:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1c700) 00010000:00010000:2.0:1783137925.172326:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137925.172329:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172334:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172351:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172357:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172361:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172366:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137925.172368:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172383:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172390:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137925.172392:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137925.172395:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.172401:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137925.172495:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:11467:x1869755299473664:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 2384us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137925.172505:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 164 00000100:00100000:2.0:1783137925.181056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137925.182678:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299473920 00000100:00100000:3.0:1783137925.182694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299473920 00000100:00100000:3.0:1783137925.182773:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:3.0:1783137925.182785:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:11467:x1869755299473920:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137925.183088:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+54:11467:x1869755299473920:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 304us (2052us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783137925.183096:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:3.0:1783137925.284488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137925.284720:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299474176 00000100:00100000:1.0:1783137925.284729:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299474176 00000100:00100000:1.0:1783137925.284781:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00100000:1.0:1783137925.284790:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+54:11470:x1869755299474176:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137925.284814:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137925.284836:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7b57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922828 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.284968:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.284995:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285006:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285020:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285027:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285032:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285307:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7b6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285319:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.285326:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137925.285336:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783137925.286126:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286137:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286397:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286471:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137925.286476:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286483:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286498:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137925.286500:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137925.286505:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286511:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ce00/0x4691dfc3d66b7b5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286525:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286531:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286537:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286541:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137925.286622:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286629:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286649:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137925.286651:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137925.286654:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286660:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286711:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7b57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922828 expref: 57 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286724:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922828 expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.286730:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:1.0:1783137925.286732:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137925.286735:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6de00, rc 0) 00000100:00100000:1.0:1783137925.286806:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+56:11470:x1869755299474176:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2015us (2326us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1783137925.286815:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00100000:1.0:1783137925.295104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137925.295168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137925.295350:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299474432 00000100:00100000:3.0:1783137925.295379:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299474432 00000100:00100000:3.0:1783137925.295480:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1783137925.295491:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+56:2352:x1869755299474432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137925.295506:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137925.295532:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6de00/0x4691dfc3d66b7b6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922828 expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.295582:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:3.0:1783137925.295587:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137925.295646:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+55:2352:x1869755299474432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 157us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.295654:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:0.0:1783137925.296803:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299474304 00000100:00100000:0.0:1783137925.296812:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299474304 00000100:00100000:0.0:1783137925.296848:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 166 00000100:00100000:0.0:1783137925.296857:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+55:11470:x1869755299474304:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:0.0:1783137925.296919:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.296945:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.296955:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.296983:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.296991:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.296998:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.297003:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137925.297007:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.297014:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.297024:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:0.0:1783137925.297027:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137925.297030:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.297036:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7b7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137925.297111:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+55:11470:x1869755299474304:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 254us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137925.297126:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 166 00000100:00100000:2.0:1783137925.320223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.320267:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299474688 00000100:00100000:2.0:1783137925.320277:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299474688 00000100:00100000:2.0:1783137925.320331:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:2.0:1783137925.320341:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:11470:x1869755299474688:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783137925.320887:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+56:11470:x1869755299474688:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 545us (672us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783137925.320896:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000001:00080000:0.0:1783137925.367948:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000001:00080000:0.0:1783137925.367989:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:0.0:1783137925.368039:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1783137925.368065:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783137925.368075:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5dc14accc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783137925.368080:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dfa732500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dc14ac480 00000020:00080000:0.0:1783137925.368083:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dfa732f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5cc2902000 00000100:00100000:3.0:1783137925.368993:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322546560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783137925.369087:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783137925.369348:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783137925.369882:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783137925.369970:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322546560 00000100:00100000:1.0:1783137925.369979:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322546560 00000100:00100000:0.0:1783137925.370187:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137925.370197:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322546560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783137925.370225:0:6617:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1783137925.370257:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a488681, atime: 0x6a488681, ctime: 0x6a488681, blocks: 0xb 00010000:00010000:0.0:1783137925.370265:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.370281:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1783137925.370286:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137925.370292:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.370307:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.370316:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.370337:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137925.370361:0:6617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137925.371254:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322546560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1056us (2164us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783137925.371263:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1783137925.371387:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137925.371395:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.371428:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137925.371432:0:7510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.371442:0:7510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.371460:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.371478:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1339cc/0x4691dfc3d66b7b81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137925.371500:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137925.371502:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137925.371504:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137925.371994:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783137925.372036:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5dc5c54e00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1783137925.372055:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322546560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783137925.545367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.545697:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299474944 00000100:00100000:2.0:1783137925.545707:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299474944 00000100:00100000:2.0:1783137925.545786:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:2.0:1783137925.545796:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+18:11488:x1869755299474944:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:2.0:1783137925.545822:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137925.545855:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392282f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.545964:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.545978:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.545989:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137925.546000:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783137925.546135:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392282f expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.546384:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392282f expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.546393:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137925.546396:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783137925.546400:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c200, rc 0) 00000100:00100000:3.0:1783137925.547028:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:11488:x1869755299474944:12345-192.168.202.24@tcp:101:cat.0 Request processed in 1231us (1668us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783137925.547037:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:1.0:1783137925.577423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.577714:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475072 00000100:00100000:2.0:1783137925.577725:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475072 00000100:00100000:2.0:1783137925.577861:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:2.0:1783137925.577872:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+20:11489:x1869755299475072:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137925.577928:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137925.577951:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922836 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578049:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578062:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578072:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137925.578275:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783137925.578280:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137925.578361:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578389:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922836 expref: 22 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578958:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922836 expref: 21 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.578972:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137925.578975:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137925.578979:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3ce00, rc 0) 00000100:00100000:2.0:1783137925.579060:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:11489:x1869755299475072:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1190us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137925.579067:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:2.0:1783137925.590649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137925.590809:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475456 00000100:00100000:0.0:1783137925.590819:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475456 00000100:00100000:0.0:1783137925.590882:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1783137925.590892:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:11489:x1869755299475456:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137925.595571:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:11489:x1869755299475456:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 4654us (4906us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1783137925.595585:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:3.0:1783137925.597621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.597708:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475584 00000100:00100000:2.0:1783137925.597715:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475584 00000100:00100000:2.0:1783137925.597774:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1783137925.597785:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+22:11489:x1869755299475584:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:2.0:1783137925.597798:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783137925.597842:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392281a expref: 22 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.597865:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392282f expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.597877:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7a38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227db expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.597887:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113f00) 00010000:00010000:2.0:1783137925.597897:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137925.598010:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:11489:x1869755299475584:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 169us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137925.598016:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1783137925.605623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137925.605819:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475712 00000100:00100000:2.0:1783137925.605830:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475712 00000100:00100000:2.0:1783137925.605885:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169 00000100:00100000:2.0:1783137925.605895:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:11489:x1869755299475712:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:2.0:1783137925.607458:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.607479:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137925.607570:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137925.618898:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783137925.621324:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:11489:x1869755299475712:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 15415us (15697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.621339:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169 00010000:00010000:3.0:1783137925.631128:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137925.684002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137925.684165:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475840 00000100:00100000:3.0:1783137925.684185:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475840 00000100:00100000:3.0:1783137925.684245:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 170 00000100:00100000:3.0:1783137925.684255:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:11491:x1869755299475840:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137925.684274:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137925.684294:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392283d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684384:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684398:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684410:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684424:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684430:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.684438:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.685481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.685494:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.685516:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137925.686767:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783137925.686774:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137925.686799:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686813:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686823:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686829:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686836:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686843:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137925.686847:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686855:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686867:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137925.686870:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137925.686874:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686896:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686913:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686918:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686924:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686928:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137925.686931:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686937:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.686945:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc39a2000) 00010000:00010000:3.0:1783137925.686948:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137925.686950:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.687020:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.687073:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.687088:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137925.687103:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783137925.687105:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137925.687109:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7800, rc 0) 00000100:00100000:3.0:1783137925.688167:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:11491:x1869755299475840:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 3908us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.688186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 170 00000100:00100000:3.0:1783137925.819101:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322547072:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137925.819238:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783137925.819244:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322546688:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819274:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137925.819298:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322547200:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819324:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137925.819356:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322546688 00000100:00100000:3.0:1783137925.819363:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322546688 00000100:00100000:3.0:1783137925.819410:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783137925.819420:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322546688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819470:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322546688:12345-0@lo:400:kworker.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.819477:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783137925.819509:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322547200 00000100:00100000:3.0:1783137925.819512:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322547200 00000100:00100000:3.0:1783137925.819580:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783137925.819588:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322547200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137925.819630:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322546944:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819649:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322547200:12345-0@lo:400:kworker.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.819655:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783137925.819658:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783137925.819671:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137925.819677:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137925.819682:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322546816:0@lo:400:kworker.0 00000100:00100000:0.0:1783137925.819703:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137925.819710:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322546688:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819722:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322547200:0@lo:400:kworker.0 00000100:00100000:0.0:1783137925.819728:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322547072 00000100:00100000:0.0:1783137925.819730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322547072 00000100:00100000:3.0:1783137925.819744:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322546944 00000100:00100000:3.0:1783137925.819746:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322546944 00000100:00100000:0.0:1783137925.819759:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322546816 00000100:00100000:0.0:1783137925.819762:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322546816 00000100:00100000:0.0:1783137925.819780:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783137925.819860:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322547072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137925.819904:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322547072:12345-0@lo:400:kworker.0 Request processed in 118us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.819934:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783137925.819943:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322546816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.819980:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322546816:12345-0@lo:400:kworker.0 Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137925.819987:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783137925.820001:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783137925.820007:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322546944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.820033:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322546944:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00080000:1.0:1783137925.820072:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137925.820120:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322546816:0@lo:400:kworker.0 00000100:00100000:1.0:1783137925.820142:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322546944:0@lo:400:kworker.0 00000100:00100000:3.0:1783137925.820855:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783137925.820897:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322547072:0@lo:400:kworker.0 00000100:00100000:0.0:1783137925.833018:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783137926.332509:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322547328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137926.332620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137926.332791:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322547328 00000100:00100000:0.0:1783137926.332799:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322547328 00000100:00100000:0.0:1783137926.332852:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783137926.332862:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322547328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137926.332901:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137926.332949:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322547328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.332957:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783137926.334046:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322547328:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783137926.586843:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137926.586852:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137926.586894:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783137926.586901:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137926.587056:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e58e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322547456:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137926.588124:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137926.592817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.593109:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e58e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322547456:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783137926.605921:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299475968 00000100:00100000:2.0:1783137926.605939:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299475968 00000100:00100000:2.0:1783137926.606051:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 171 00000100:00100000:2.0:1783137926.606064:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299475968:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137926.606101:0:11954:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137926.606471:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299475968:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 409us (13662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137926.606480:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 171 00000100:00100000:2.0:1783137926.624152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.624369:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299476096 00000100:00100000:3.0:1783137926.624391:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299476096 00000100:00100000:3.0:1783137926.624449:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:3.0:1783137926.624459:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299476096:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783137926.624583:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624600:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624614:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624630:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624636:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624642:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624668:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624676:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624683:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137926.624723:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783137926.624727:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137926.624739:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624750:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624763:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624770:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624776:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137926.624781:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624788:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624800:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137926.624803:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137926.624807:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624814:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7bce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624828:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624834:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624840:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624845:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137926.624854:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624861:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624869:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e5dc39a2000) 00010000:00010000:3.0:1783137926.624872:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137926.624875:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624880:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7bd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624896:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624902:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624908:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624913:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137926.624916:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624921:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624928:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783137926.624931:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137926.624939:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.624945:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.625019:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299476096:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 560us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137926.625029:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 172 00000100:00100000:0.0:1783137926.633689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.634026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299476352 00000100:00100000:3.0:1783137926.634045:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299476352 00000100:00100000:3.0:1783137926.634106:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:3.0:1783137926.634117:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299476352:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137926.634147:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137926.634168:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7be3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922844 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634281:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634295:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634306:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137926.634317:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783137926.634423:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634431:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634447:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634452:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137926.634457:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634464:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634476:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783137926.634479:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137926.634483:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634489:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634530:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7be3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922844 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634541:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137926.634584:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137926.634590:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7be3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922844 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.634599:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783137926.634665:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299476352:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 550us (986us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1783137926.634682:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:3.0:1783137926.640119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137926.640521:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299476480 00000100:00100000:2.0:1783137926.640531:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299476480 00000100:00100000:2.0:1783137926.640619:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:2.0:1783137926.640629:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299476480:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137926.640666:0:11954:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137926.642856:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299476480:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 2217us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137926.642870:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174 00010000:00010000:0.0:1783137926.661634:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137926.663052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.667359:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299476736 00000100:00100000:3.0:1783137926.667376:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299476736 00000100:00100000:3.0:1783137926.667573:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:3.0:1783137926.667586:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299476736:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137926.667609:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137926.667613:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783137926.667642:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b7ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922836 expref: 21 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.667663:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137926.667669:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137926.667683:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7bf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392284b expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137926.669666:0:7189:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1783137926.669963:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.669982:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.669995:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.670079:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7bf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392284b expref: 23 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.670118:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392284b expref: 22 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.670126:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dc39a2000) 00010000:00010000:3.0:1783137926.670140:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137926.670144:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783137926.671774:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+22:11503:x1869755299476736:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 4181us (8730us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783137926.671786:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 175 00000100:00100000:1.0:1783137926.688713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137926.688755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299476992 00000100:00100000:1.0:1783137926.688765:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299476992 00000100:00100000:1.0:1783137926.688814:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1783137926.688824:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+22:11503:x1869755299476992:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783137926.688887:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137926.688919:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b7bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392284b expref: 22 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.688939:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dc39a2000) 00010000:00010000:1.0:1783137926.688949:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137926.688972:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.688985:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.688994:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689041:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689050:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689056:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689541:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689571:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689577:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689583:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137926.689588:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689773:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689783:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137926.689786:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137926.689790:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689795:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7c0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689805:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689811:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689816:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689827:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137926.689830:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689835:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689843:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x66b8d3e9 (ffff8e5dc5113e00) 00010000:00010000:1.0:1783137926.689845:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137926.689848:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.689853:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7c14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66b8d3e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137926.689944:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299476992:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1120us (1241us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783137926.689952:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 176 00000100:00100000:1.0:1783137926.708581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.711171:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299477120 00000100:00100000:0.0:1783137926.711188:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299477120 00000100:00100000:0.0:1783137926.711272:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:0.0:1783137926.711283:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299477120:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137926.711305:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137926.711330:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922852 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.711368:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.713258:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.713294:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.713508:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 23 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.713530:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 22 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.713539:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137926.713563:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137926.713567:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045200, rc 0) 00000100:00100000:0.0:1783137926.714345:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+22:11503:x1869755299477120:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 3056us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.714355:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 177 00000100:00100000:0.0:1783137926.725371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.725904:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299477376 00000100:00100000:3.0:1783137926.725916:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299477376 00000100:00100000:3.0:1783137926.725974:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:3.0:1783137926.725985:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+22:11503:x1869755299477376:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137926.726082:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.726099:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.726111:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137926.726633:0:7189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1783137926.726644:0:7189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416619098607ns, next at 417619096697ns, rc = 0 00000004:00010000:3.0:1783137926.726727:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9239a40 reply state 0000000045c5f2ee transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.726753:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137926.726849:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+24:11503:x1869755299477376:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 864us (1486us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783137926.726857:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:2.0:1783137926.736104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.739422:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299477504 00000100:00100000:0.0:1783137926.739447:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299477504 00000100:00100000:0.0:1783137926.739515:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:0.0:1783137926.739525:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+24:11503:x1869755299477504:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137926.739565:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137926.739585:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922859 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.739649:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.739678:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.739699:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137926.739702:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137926.739706:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045400, rc 0) 00000100:00100000:0.0:1783137926.739768:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+25:11503:x1869755299477504:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 244us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.739774:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179 00010000:00010000:3.0:1783137926.747860:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747879:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747887:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747894:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137926.747899:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747907:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747925:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:3.0:1783137926.747929:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783137926.747933:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.747939:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7c29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137926.748403:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.748529:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299477632 00000100:00100000:0.0:1783137926.748539:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299477632 00000100:00100000:0.0:1783137926.748634:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:0.0:1783137926.748644:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299477632:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783137926.748987:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299477632:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 343us (586us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783137926.748996:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00080000:1.0:1783137926.749065:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137926.757969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137926.764667:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299477888 00000100:00100000:2.0:1783137926.764682:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299477888 00000100:00100000:2.0:1783137926.764754:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1783137926.764766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:11503:x1869755299477888:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783137926.765020:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+25:11503:x1869755299477888:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 256us (7060us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783137926.765028:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1783137926.775994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.777590:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478144 00000100:00100000:0.0:1783137926.777603:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478144 00000100:00100000:0.0:1783137926.777660:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:0.0:1783137926.777671:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+25:11503:x1869755299478144:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137926.777793:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+25:11503:x1869755299478144:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 123us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.777801:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 180 00000100:00100000:3.0:1783137926.783224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.785949:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478272 00000100:00100000:0.0:1783137926.785974:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478272 00000100:00100000:0.0:1783137926.786049:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:0.0:1783137926.786062:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+25:11503:x1869755299478272:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137926.786084:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137926.786106:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922860 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786178:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786193:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786205:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137926.786247:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137926.786268:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786297:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922860 expref: 27 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786334:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922860 expref: 26 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137926.786343:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137926.786346:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783137926.786351:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044000, rc 0) 00000100:00100000:0.0:1783137926.786664:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+26:11503:x1869755299478272:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 604us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.786681:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 181 00000100:00100000:3.0:1783137926.791431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137926.792576:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478400 00000100:00100000:1.0:1783137926.792593:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478400 00000100:00100000:1.0:1783137926.792655:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1783137926.792666:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2350:x1869755299478400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137926.792686:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137926.792710:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922867 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137926.792745:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a488685, blocks: 0x1 00010000:00010000:1.0:1783137926.792764:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783137926.792769:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137926.792779:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.792796:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137926.792810:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c400, rc 0) 00000100:00100000:1.0:1783137926.792880:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2350:x1869755299478400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 216us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137926.792887:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:3.0:1783137926.800907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137926.801599:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478656 00000100:00100000:2.0:1783137926.801616:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478656 00000100:00100000:2.0:1783137926.801689:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:2.0:1783137926.801700:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:11503:x1869755299478656:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783137926.801819:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+26:11503:x1869755299478656:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 120us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137926.801826:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 182 00000100:00100000:3.0:1783137926.809532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.809632:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478784 00000100:00100000:3.0:1783137926.809647:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478784 00000100:00100000:3.0:1783137926.809719:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1783137926.809734:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:11503:x1869755299478784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137926.809759:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137926.809785:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392286e expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.809827:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 9 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.809837:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137926.809842:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137926.809848:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 9 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.809894:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 9 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.809912:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 9 pid: 6615 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.809931:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322547584:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137926.810065:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137926.813021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.813088:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299478912 00000100:00100000:3.0:1783137926.813101:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299478912 00010000:00010000:3.0:1783137926.816772:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 10 pid: 6615 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.816856:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:3.0:1783137926.816887:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+10:2352:x1869755299478912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137926.816909:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137926.816939:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 10 pid: 6615 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.816956:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 10 pid: 6615 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.816991:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137926.816998:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137926.817009:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.817023:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.817087:0:6630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 10 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.817104:0:6630:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6630:1869755322547712:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783137926.818539:0:6630:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc5ef3780 going to sleep for 11 seconds 00000040:00080000:2.0:1783137926.819910:0:12345:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137926.819919:0:12345:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137926.819962:0:12345:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783137926.819971:0:12345:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783137926.822374:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b7c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922867 expref: 10 pid: 6615 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137926.822407:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322547584:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137926.822455:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 9 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137926.822475:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783137926.822575:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:11503:x1869755299478784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 12845us (13062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137926.822586:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1783137926.838090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.838179:0:6630:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6630:1869755322547712:192.168.202.24@tcp:105: 00000100:00100000:1.0:1783137926.838189:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479040 00000100:00100000:1.0:1783137926.838206:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479040 00010000:00010000:3.0:1783137926.838209:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137926.838286:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299478912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 21418us (25279us total) trans 0 rc 0/0 00002000:00100000:1.0:1783137926.838293:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e5df58ead80 x1869755299479040/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:77/0 lens 504/0 e 0 to 0 dl 1783137937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783137926.838307:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00002000:00100000:1.0:1783137926.838320:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df58ead80 with x1869755299479040 ext(0->8) 00002000:00010000:1.0:1783137926.838329:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df58ead80 00000100:00100000:1.0:1783137926.838386:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1783137926.838401:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299479040:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783137926.844526:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+10:2352:x1869755299479040:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 6119us (6435us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783137926.844569:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00002000:00100000:1.0:1783137926.844582:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e5df58ead80 x1869755299479040/t4294967314(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:77/0 lens 504/448 e 0 to 0 dl 1783137937 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137926.844593:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df58ead80 with x1869755299479040 ext(0->8) 00002000:00010000:1.0:1783137926.844599:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df58ead80 00000100:00100000:3.0:1783137926.864880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137926.864961:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479168 00000100:00100000:0.0:1783137926.864977:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479168 00000100:00100000:0.0:1783137926.865066:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:0.0:1783137926.865079:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+26:11503:x1869755299479168:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783137926.985803:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+26:11503:x1869755299479168:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 120714us (120930us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137926.985817:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 183 00000001:00080000:0.0:1783137926.985862:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:0.0:1783137926.985871:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1783137926.985878:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1783137926.985894:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1783137926.985915:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1783137926.985925:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783137926.986055:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322547840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783137926.986113:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137926.986266:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322547840 00000100:00100000:1.0:1783137926.986281:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322547840 00000100:00100000:1.0:1783137926.986362:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137926.986374:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322547840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783137926.986914:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783137926.986919:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783137925 00002000:00010000:1.0:1783137926.986922:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783137926.986924:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783137925 -> 1783137925 00002000:00010000:1.0:1783137926.986925:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783137926.988216:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322547840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1836us (2092us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783137926.988231:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1783137926.990393:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5df594c700/2, rc 0, transno 4294967315 00000100:00100000:3.0:1783137926.990410:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322547840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783137926.993753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137926.993903:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479296 00000100:00100000:3.0:1783137926.993915:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479296 00000100:00100000:3.0:1783137926.993980:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1783137926.993989:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+10:2353:x1869755299479296:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783137927.125874:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1783137927.125894:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1783137927.125899:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1783137927.127123:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299479296:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 133127us (133373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137927.127146:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1783137927.142808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.142908:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479552 00000100:00100000:0.0:1783137927.142921:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479552 00000100:00100000:0.0:1783137927.143020:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:0.0:1783137927.143046:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:11503:x1869755299479552:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137927.143122:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137927.143163:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922860 expref: 19 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.143185:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137927.143204:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137927.143245:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.143261:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.143272:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137927.143643:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000984f82fc reply state 00000000f1cb98ed transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.143654:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137927.143779:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+20:11503:x1869755299479552:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 746us (982us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783137927.143790:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00080000:1.0:1783137927.144087:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783137927.148423:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148451:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148475:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148483:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137927.148489:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148498:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148524:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:1.0:1783137927.148528:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137927.148533:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.148540:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7c53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137927.176477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137927.176526:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479680 00000100:00100000:1.0:1783137927.176536:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479680 00000100:00100000:1.0:1783137927.176621:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1783137927.176631:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299479680:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783137927.194283:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783137927.194294:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783137925 -> 1783137924 00002000:00010000:1.0:1783137927.194297:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783137921 00002000:00010000:1.0:1783137927.194299:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783137925 -> 1783137924 00002000:00010000:1.0:1783137927.194302:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783137927.195229:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2353:x1869755299479680:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 18591us (18754us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1783137927.195255:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:0.0:1783137927.213830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.213893:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299479936 00000100:00100000:0.0:1783137927.213906:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299479936 00000100:00100000:0.0:1783137927.214064:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:0.0:1783137927.214080:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11503:x1869755299479936:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783137927.214262:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.214286:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 19 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.214297:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.214379:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 19 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.214397:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 19 pid: 11954 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.214415:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322547968:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137927.214538:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa1810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137927.222641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.222727:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480064 00000100:00100000:0.0:1783137927.222742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480064 00010000:00010000:0.0:1783137927.222803:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 20 pid: 11954 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.222856:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:0.0:1783137927.222868:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:2353:x1869755299480064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137927.222888:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137927.222896:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 20 pid: 11954 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.225400:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 20 pid: 11954 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.225448:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137927.225455:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.225486:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.225495:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.225529:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137927.225718:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:2353:x1869755299480064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2850us (3087us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137927.225731:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00010000:00010000:2.0:1783137927.228794:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922852 expref: 19 pid: 11954 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137927.228839:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1869755322547968:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137927.228869:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228879:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228885:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228917:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228925:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228932:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228937:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137927.228942:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228949:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228965:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:2.0:1783137927.228969:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783137927.228973:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.228986:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137927.229099:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+18:11503:x1869755299479936:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 15023us (15289us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783137927.229109:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 185 00000100:00100000:2.0:1783137927.234783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.235083:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480192 00000100:00100000:0.0:1783137927.235102:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480192 00000100:00100000:0.0:1783137927.235195:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:0.0:1783137927.235210:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2351:x1869755299480192:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783137927.235276:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.235304:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.235315:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783137927.235320:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137927.235325:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.235372:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.235415:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 8 pid: 6617 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.235435:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322548096:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137927.235576:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137927.247706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137927.250300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480320 00000100:00100000:1.0:1783137927.250316:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480320 00010000:00010000:1.0:1783137927.250366:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 9 pid: 6617 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137927.250413:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:1.0:1783137927.250424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299480320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137927.250441:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137927.250466:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 9 pid: 6617 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.250481:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 9 pid: 6617 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.250510:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137927.250515:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137927.250521:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.250531:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.250574:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137927.250646:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299480320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 223us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137927.250671:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00010000:00010000:0.0:1783137927.260570:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7c4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392286e expref: 8 pid: 6617 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.260596:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322548096:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137927.260628:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.260996:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261007:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261071:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261081:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261090:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261098:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137927.261102:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261146:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261166:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.261174:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1339cc/0x4691dfc3d66b7c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137927.261270:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299480192:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 26063us (26494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137927.261279:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:2.0:1783137927.265294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.265369:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480576 00000100:00100000:0.0:1783137927.265378:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480576 00000100:00100000:0.0:1783137927.265439:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 186 00000100:00100000:0.0:1783137927.265450:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+18:11503:x1869755299480576:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783137927.265528:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265584:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265597:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265819:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265832:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265841:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265878:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.265892:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 19 pid: 5813 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.265907:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548224:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137927.265997:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137927.273286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137927.273413:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480704 00000100:00100000:0.0:1783137927.273428:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480704 00010000:00010000:0.0:1783137927.273482:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 20 pid: 5813 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.273534:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:0.0:1783137927.273573:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:2353:x1869755299480704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137927.273589:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137927.273596:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 20 pid: 5813 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.273627:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 20 pid: 5813 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.273649:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137927.273654:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.273664:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.273672:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.273708:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137927.273774:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:2353:x1869755299480704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 203us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137927.273781:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00010000:00010000:2.0:1783137927.280297:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922859 expref: 19 pid: 5813 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137927.280324:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548224:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137927.280352:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.280365:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.280371:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137927.280907:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1783137927.282070:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1783137927.282154:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1783137927.282257:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322548352:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783137927.282332:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137927.282368:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de021db40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137927.282600:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322548352 00000100:00100000:0.0:1783137927.282608:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322548352 00000100:00100000:0.0:1783137927.282679:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137927.282690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322548352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783137927.282781:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322548352:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137927.282790:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783137927.283006:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137927.287211:0:5812:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1783137927.287231:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5df594c700, transno 4294967315 00000100:00100000:3.0:1783137927.287263:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa391500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322548352:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783137927.287981:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1783137927.288094:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322548480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783137927.288176:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137927.288217:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137927.290321:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322548480 00000100:00100000:0.0:1783137927.290337:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322548480 00000100:00100000:0.0:1783137927.290416:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137927.290426:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1869755322548480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783137927.290810:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1869755322548480:12345-0@lo:1000:mdt00_001.0 Request processed in 385us (2633us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783137927.290819:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137927.290872:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1869755322548480:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783137927.290914:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290924:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290932:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290938:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137927.290943:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290949:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290965:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137927.290968:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137927.290972:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.290978:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7c6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291008:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291037:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291044:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291049:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137927.291052:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291068:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291076:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:0.0:1783137927.291079:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137927.291082:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291088:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c200/0x4691dfc3d66b7bab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291108:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291123:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291133:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291163:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137927.291183:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 22 pid: 5812 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137927.291196:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548608:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137927.291262:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa1813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137927.295350:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548608:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137927.295381:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137927.295528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137927.297224:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299480832 00000100:00100000:1.0:1783137927.297238:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299480832 00010000:00010000:1.0:1783137927.297294:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 23 pid: 5812 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137927.297339:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:1.0:1783137927.297349:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+23:2352:x1869755299480832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137927.297365:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137927.297383:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 23 pid: 5812 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297399:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 23 pid: 5812 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297426:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392283d expref: 23 pid: 5812 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297446:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:1.0:1783137927.297451:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297461:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297470:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.297518:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137927.297595:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:2352:x1869755299480832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 246us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137927.297603:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00010000:00010000:3.0:1783137927.297755:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297764:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297776:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297783:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297790:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297795:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137927.297799:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297815:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297824:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783137927.297827:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137927.297830:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297835:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7c76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297847:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297853:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297858:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297863:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137927.297919:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297926:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297934:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783137927.297936:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783137927.297939:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137927.297956:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7c68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137927.298216:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299480576:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 32767us (32930us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1783137927.298225:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 186 00000020:00080000:3.0:1783137927.298230:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783137927.298372:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137927.298378:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137927.298914:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1783137927.298923:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137927.312806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137927.313202:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481088 00000100:00100000:3.0:1783137927.313211:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481088 00000100:00100000:3.0:1783137927.313270:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:3.0:1783137927.313280:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6706450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:11503:x1869755299481088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783137927.317946:0:5815:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783137927.318244:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1783137927.318323:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318339:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318350:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318359:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318365:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318371:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137927.318392:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783137927.318509:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6706450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+23:11503:x1869755299481088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 5225us (5708us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1783137927.318527:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000020:00080000:2.0:1783137927.318533:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783137927.320100:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137927.320111:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.320122:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783137927.320128:0:7510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.320137:0:7510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.320153:0:7510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e5de2d1cd00) 00010000:00010000:1.0:1783137927.320156:0:7510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783137927.320160:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.320167:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7c7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137927.320188:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137927.320190:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137927.320191:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137927.676788:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783137928.009204:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1783137928.313732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137928.313778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137928.313804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137928.313831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137928.313869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137928.313904:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481728 00000100:00100000:1.0:1783137928.313913:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481728 00000100:00100000:1.0:1783137928.313977:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481344 00000100:00100000:1.0:1783137928.313981:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481344 00000100:00100000:1.0:1783137928.314004:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:1.0:1783137928.314014:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299481728:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137928.314330:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2353:x1869755299481728:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 316us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137928.314339:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173 00000100:00100000:1.0:1783137928.314357:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:1.0:1783137928.314363:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+23:2353:x1869755299481344:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137928.314394:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+23:2353:x1869755299481344:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137928.314401:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174 00000100:00100000:1.0:1783137928.314422:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481472 00000100:00100000:1.0:1783137928.314426:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481472 00000100:00100000:1.0:1783137928.314453:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481600 00000100:00100000:1.0:1783137928.314456:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481600 00000100:00100000:1.0:1783137928.314476:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:1.0:1783137928.314483:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299481472:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137928.314510:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299481472:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137928.314517:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:1.0:1783137928.314528:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:1.0:1783137928.314534:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299481600:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137928.314614:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299481600:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 80us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137928.314621:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00080000:1.0:1783137928.314637:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137928.314653:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137928.314655:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137928.317688:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481216 00000100:00100000:3.0:1783137928.317704:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481216 00000100:00100000:0.0:1783137928.337707:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 304 00000100:00100000:0.0:1783137928.337727:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299481216:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137928.337821:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2353:x1869755299481216:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 101us (24099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137928.337829:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 304 00010000:00010000:2.0:1783137928.709313:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137928.892468:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137928.892492:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322548736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137928.892625:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137928.896299:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322548736 00000100:00100000:1.0:1783137928.896314:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322548736 00000100:00100000:1.0:1783137928.896423:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783137928.896434:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322548736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137928.896473:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137928.896611:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322548736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137928.896619:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783137928.897080:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1783137928.897088:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5dc5c54e00, transno 4294967307 00000100:00100000:0.0:1783137928.897128:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322548736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137928.900145:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1783137929.330312:0:12399:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137929.330324:0:12399:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137929.330363:0:12399:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783137929.330369:0:12399:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783137929.338969:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137929.338979:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137929.339023:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783137929.339037:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137929.588801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137929.596137:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299481984 00000100:00100000:2.0:1783137929.596152:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299481984 00000100:00100000:2.0:1783137929.596232:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:2.0:1783137929.596244:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+23:11521:x1869755299481984:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137929.596266:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137929.596288:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922875 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.596568:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7c8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.596584:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.596597:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137929.596609:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:0.0:1783137929.596837:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137929.597082:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922875 expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.597113:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922875 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.597123:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137929.597126:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137929.597130:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c400, rc 0) 00000100:00100000:2.0:1783137929.597245:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+25:11521:x1869755299481984:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1003us (8451us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1783137929.597253:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 187 00000100:00100000:0.0:1783137929.632025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137929.632137:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299482112 00000100:00100000:1.0:1783137929.632148:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299482112 00000100:00100000:1.0:1783137929.632207:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:1.0:1783137929.632216:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+25:11521:x1869755299482112:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:1.0:1783137929.632292:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.632310:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.632322:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.632335:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.632350:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.632356:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633033:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633043:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633051:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137929.633088:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633100:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633223:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633229:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633235:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137929.633239:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633247:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633267:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137929.633270:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137929.633274:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633280:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7c99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633292:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633298:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633303:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633309:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137929.633312:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633317:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633324:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113000) 00010000:00010000:1.0:1783137929.633327:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137929.633330:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633335:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633361:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633368:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633374:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633379:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137929.633382:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633388:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633396:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113200) 00010000:00010000:1.0:1783137929.633398:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137929.633401:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.633407:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7ca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137929.633562:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+25:11521:x1869755299482112:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1319us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137929.633732:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 188 00010000:00010000:1.0:1783137929.722757:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137929.735110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137929.735224:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299482368 00000100:00100000:1.0:1783137929.735234:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299482368 00000100:00100000:1.0:1783137929.735310:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:1.0:1783137929.735321:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+25:11524:x1869755299482368:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137929.735342:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137929.735361:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392287c expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735435:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735451:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735462:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735477:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735484:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.735491:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736036:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736046:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736054:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137929.736075:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783137929.736164:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736173:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736179:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736186:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137929.736190:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736199:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736211:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137929.736215:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137929.736219:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736226:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736238:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736250:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736268:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736273:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137929.736276:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736282:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736291:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113200) 00010000:00010000:1.0:1783137929.736293:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137929.736296:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736302:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736343:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 28 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736356:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 27 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.736363:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:1.0:1783137929.736365:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137929.736367:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6cc00, rc 0) 00000100:00100000:1.0:1783137929.736420:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:11524:x1869755299482368:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1101us (1320us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783137929.736435:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:0.0:1783137929.751388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137929.751496:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299482496 00000100:00100000:2.0:1783137929.751506:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299482496 00000100:00100000:2.0:1783137929.751606:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:2.0:1783137929.751618:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+27:11524:x1869755299482496:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1783137929.751687:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751703:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751807:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751835:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751842:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751869:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751875:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137929.751880:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751888:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751901:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:2.0:1783137929.751904:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137929.751908:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.751914:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137929.751985:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+27:11524:x1869755299482496:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 369us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137929.751993:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 190 00000100:00100000:0.0:1783137929.758038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137929.758184:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299482752 00000100:00100000:3.0:1783137929.758196:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299482752 00000100:00100000:3.0:1783137929.758289:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1783137929.758300:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:11524:x1869755299482752:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137929.758533:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+28:11524:x1869755299482752:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 234us (503us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783137929.758580:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1783137929.833851:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137929.833993:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483008 00000100:00100000:2.0:1783137929.834003:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483008 00000100:00100000:2.0:1783137929.834066:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:2.0:1783137929.834077:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+28:11050:x1869755299483008:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137929.834100:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137929.834134:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922883 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.834261:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.834277:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 29 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.834286:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.834318:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 29 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.834331:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 29 pid: 7189 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137929.834344:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322548864:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137929.834439:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137929.844756:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322548864:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137929.844789:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137929.850704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137929.851171:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483136 00000100:00100000:0.0:1783137929.851182:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483136 00010000:00010000:0.0:1783137929.851226:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 30 pid: 7189 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137929.851269:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 74 00000100:00100000:0.0:1783137929.851280:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+30:2353:x1869755299483136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137929.851297:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137929.851304:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 30 pid: 7189 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851317:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 30 pid: 7189 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851337:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7cc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392287c expref: 30 pid: 7189 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851353:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:0.0:1783137929.851359:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851368:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851390:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137929.851425:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137929.851487:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+29:2353:x1869755299483136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 208us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137929.851495:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 74 00010000:00010000:2.0:1783137929.852091:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.852111:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137929.852133:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783137929.852293:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c600/0x4691dfc3d66b7cd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.852313:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.852320:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:2.0:1783137929.852324:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137929.852327:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3de00, rc 0) 00000100:00100000:2.0:1783137929.852364:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+29:11050:x1869755299483008:12345-192.168.202.24@tcp:101:bash.0 Request processed in 18290us (18523us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783137929.852372:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 191 00000100:00100000:1.0:1783137929.862640:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137929.862940:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483392 00000100:00100000:3.0:1783137929.862951:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483392 00000100:00100000:3.0:1783137929.863021:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 192 00000100:00100000:3.0:1783137929.863033:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+29:11050:x1869755299483392:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:3.0:1783137929.863314:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.863347:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.863360:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137929.863419:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783137929.863445:0:7189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a20adf36 reply state 0000000052e86e55 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137929.863455:0:7189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783137929.863505:0:7189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1783137929.864145:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+33:11050:x1869755299483392:12345-192.168.202.24@tcp:36:bash.0 Request processed in 1111us (1512us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783137929.864153:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 192 00000020:00080000:3.0:1783137929.864159:0:7189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783137929.873376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1783137929.873467:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873480:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873487:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873494:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137929.873498:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873505:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873540:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:3.0:1783137929.873584:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137929.873590:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137929.873596:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ced lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137929.874140:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483520 00000100:00100000:1.0:1783137929.874150:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483520 00000100:00100000:1.0:1783137929.874204:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:1.0:1783137929.874216:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:11050:x1869755299483520:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783137929.874241:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137929.874257:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392288a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.874312:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392288a expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.874327:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392288a expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137929.874344:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:1.0:1783137929.874347:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137929.874350:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d600, rc 0) 00000100:00100000:1.0:1783137929.874415:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+33:11050:x1869755299483520:12345-192.168.202.24@tcp:101:bash.0 Request processed in 201us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137929.874422:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:1.0:1783137929.879490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137929.879591:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483648 00000100:00100000:2.0:1783137929.879601:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483648 00000100:00100000:2.0:1783137929.879704:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:2.0:1783137929.879730:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:11050:x1869755299483648:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137929.879748:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137929.879768:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922891 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137929.879794:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a488684, atime: 0x6a488681, ctime: 0x6a488684, blocks: 0xb 00010000:00010000:2.0:1783137929.879817:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783137929.879822:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137929.879831:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.879847:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137929.879875:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c600, rc 0) 00000100:00100000:2.0:1783137929.879941:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:11050:x1869755299483648:12345-192.168.202.24@tcp:101:bash.0 Request processed in 227us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137929.879948:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1783137929.890092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137929.890245:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483776 00000100:00100000:2.0:1783137929.890256:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483776 00002000:00010000:2.0:1783137929.890297:0:6621:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783137929.890302:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5e0ed80 with x1869755299483776 ext(0->18446744073709551615) 00002000:00010000:2.0:1783137929.890313:0:6621:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df5e0ed80. 00000100:00100000:2.0:1783137929.890350:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:2.0:1783137929.890361:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2350:x1869755299483776:12345-192.168.202.24@tcp:10:bash.0 00002000:00010000:2.0:1783137929.890679:0:6621:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783137929.890683:0:6621:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783137924 -> 1783137928 00002000:00010000:2.0:1783137929.890685:0:6621:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783137921 -> 1783137921 00002000:00010000:2.0:1783137929.890688:0:6621:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783137924 -> 1783137928 00002000:00010000:2.0:1783137929.890690:0:6621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783137929.891003:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2350:x1869755299483776:12345-192.168.202.24@tcp:10:bash.0 Request processed in 641us (917us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1783137929.891024:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00002000:00010000:2.0:1783137929.891029:0:6621:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783137929.891032:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5e0ed80 with x1869755299483776 ext(0->18446744073709551615) 00002000:00010000:2.0:1783137929.891037:0:6621:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df5e0ed80. 00000100:00100000:3.0:1783137930.098295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.098361:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299483904 00000100:00100000:2.0:1783137930.098372:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299483904 00000100:00100000:2.0:1783137930.098501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:2.0:1783137930.098514:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+33:11538:x1869755299483904:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:2.0:1783137930.098652:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.098670:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.098681:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.098697:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.098704:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.098710:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099012:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099032:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099040:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137930.099079:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099091:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099104:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099112:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099117:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.099122:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099129:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099142:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137930.099145:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.099149:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099156:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099169:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099175:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099181:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099186:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.099194:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099201:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099209:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1cb00) 00010000:00010000:2.0:1783137930.099211:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.099214:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099220:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099234:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099240:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099245:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099250:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.099253:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099258:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099264:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:2.0:1783137930.099266:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.099275:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.099281:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.099350:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+33:11538:x1869755299483904:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 838us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.099358:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:1.0:1783137930.172032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.172471:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299484160 00000100:00100000:3.0:1783137930.172482:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299484160 00000100:00100000:3.0:1783137930.172576:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:3.0:1783137930.172588:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+33:11541:x1869755299484160:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137930.172609:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137930.172643:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922898 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172724:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172738:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172750:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172761:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172766:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.172777:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173030:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7d2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173039:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173047:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137930.173061:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783137930.173153:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173162:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173169:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173175:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137930.173180:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173187:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173198:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137930.173202:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137930.173213:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173219:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7d1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173237:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173243:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173248:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173252:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137930.173255:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173260:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173268:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc39a2800) 00010000:00010000:3.0:1783137930.173270:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137930.173273:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173278:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173316:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922898 expref: 36 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173343:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922898 expref: 35 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.173351:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:3.0:1783137930.173354:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783137930.173357:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7c00, rc 0) 00000100:00100000:3.0:1783137930.173433:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+35:11541:x1869755299484160:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 846us (1411us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1783137930.173440:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 195 00000100:00100000:0.0:1783137930.184461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.184590:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299484288 00000100:00100000:3.0:1783137930.184601:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299484288 00000100:00100000:3.0:1783137930.184660:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:3.0:1783137930.184671:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:11541:x1869755299484288:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1783137930.184739:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.184756:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.184765:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.184799:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.184812:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 35 pid: 5813 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137930.184839:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548992:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137930.184937:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137930.190685:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1869755322548992:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137930.190716:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.190909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.190973:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299484544 00000100:00100000:2.0:1783137930.190980:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299484544 00000100:00100000:2.0:1783137930.191058:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:2.0:1783137930.191069:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:5580:x1869755299484544:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783137930.191388:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+37:5580:x1869755299484544:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 319us (477us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1783137930.191395:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:0.0:1783137930.199602:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.199760:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299484672 00000100:00100000:3.0:1783137930.199770:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299484672 00010000:00010000:3.0:1783137930.199811:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 37 pid: 5813 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137930.199854:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 75 00000100:00100000:3.0:1783137930.199864:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+37:2353:x1869755299484672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137930.199881:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137930.199888:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 37 pid: 5813 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.199901:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 37 pid: 5813 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.200296:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7cdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922883 expref: 37 pid: 5813 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.200313:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:3.0:1783137930.200318:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.200343:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.200351:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.200391:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137930.200448:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+36:2353:x1869755299484672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 586us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137930.200457:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 75 00010000:00010000:2.0:1783137930.202131:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202146:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202181:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202188:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202195:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202223:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.202229:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202236:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202250:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:2.0:1783137930.202252:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137930.202256:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.202262:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7d3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.202347:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:11541:x1869755299484288:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 17676us (17893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.202356:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 196 00000100:00100000:0.0:1783137930.208680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.208990:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299484928 00000100:00100000:3.0:1783137930.209000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299484928 00000100:00100000:3.0:1783137930.209069:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:3.0:1783137930.209080:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+35:11541:x1869755299484928:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137930.209347:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+36:11541:x1869755299484928:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 268us (680us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1783137930.209355:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:0.0:1783137930.394676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.394818:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299485184 00000100:00100000:2.0:1783137930.394828:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299485184 00000100:00100000:2.0:1783137930.394887:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:2.0:1783137930.394897:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+36:11552:x1869755299485184:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:2.0:1783137930.394931:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137930.394954:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392289f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395041:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395073:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395084:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395099:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395117:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395123:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395428:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395437:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395445:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137930.395455:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783137930.395593:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395601:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395609:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395620:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.395625:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395633:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395645:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137930.395648:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.395653:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395658:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395672:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395677:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395682:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395687:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.395689:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395695:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395716:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1cb00) 00010000:00010000:2.0:1783137930.395718:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.395721:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395727:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395769:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392289f expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395785:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392289f expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.395792:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:2.0:1783137930.395794:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137930.395796:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3dc00, rc 0) 00000100:00100000:2.0:1783137930.395866:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+38:11552:x1869755299485184:12345-192.168.202.24@tcp:101:cat.0 Request processed in 970us (1199us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1783137930.395873:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 197 00000100:00100000:0.0:1783137930.403855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.405231:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299485440 00000100:00100000:3.0:1783137930.405244:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299485440 00000100:00100000:3.0:1783137930.405315:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:3.0:1783137930.405328:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+38:11552:x1869755299485440:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:3.0:1783137930.405813:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+39:11552:x1869755299485440:12345-192.168.202.24@tcp:35:cat.0 Request processed in 487us (1964us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783137930.405822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1783137930.455130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137930.455276:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299485696 00000100:00100000:1.0:1783137930.455286:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299485696 00000100:00100000:1.0:1783137930.455352:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 198 00000100:00100000:1.0:1783137930.455363:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:11553:x1869755299485696:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1783137930.455433:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783137930.455463:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392289f expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455490:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7d2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922898 expref: 38 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455505:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392288a expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455516:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113000) 00010000:00010000:1.0:1783137930.455528:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137930.455618:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455633:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455643:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455657:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455664:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.455691:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456028:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456036:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456044:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137930.456679:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1783137930.456689:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420349143447ns, next at 421349141312ns, rc = 0 00010000:00010000:1.0:1783137930.456744:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456752:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456760:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456767:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456773:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456778:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456818:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137930.456839:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456846:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456852:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456858:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ca00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137930.456863:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456872:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456880:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113500) 00010000:00010000:1.0:1783137930.456883:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783137930.456887:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456893:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7d72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456909:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456915:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456921:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456933:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137930.456936:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456942:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456950:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137930.456953:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137930.456956:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.456962:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d400/0x4691dfc3d66b7d64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137930.456973:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022ed6981 reply state 0000000040873eb8 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137930.456982:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137930.457070:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+38:11553:x1869755299485696:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1707us (1949us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1783137930.457078:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 198 00010000:00010000:0.0:1783137930.457584:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137930.457591:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.457598:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783137930.457602:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.457619:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.457629:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e5dc5113500) 00010000:00010000:0.0:1783137930.457631:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783137930.457643:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.457649:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7d79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.457664:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137930.457666:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137930.457667:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137930.462335:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462353:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462360:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462384:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137930.462389:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462395:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462412:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113200) 00010000:00010000:1.0:1783137930.462415:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137930.462420:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.462427:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7d6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.532363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.532464:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299485952 00000100:00100000:2.0:1783137930.532474:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299485952 00000100:00100000:2.0:1783137930.532572:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 199 00000100:00100000:2.0:1783137930.532585:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+37:11559:x1869755299485952:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137930.533366:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137930.533391:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228a6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533744:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533759:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533770:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533783:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533790:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.533795:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137930.534402:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1783137930.535407:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535422:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535432:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535469:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535488:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535495:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535502:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137930.535506:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535513:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535525:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137930.535527:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137930.535531:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535536:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7d87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137930.535568:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081003ea2 reply state 00000000ae579e96 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.535577:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783137930.535866:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7d80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535883:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.535902:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:2.0:1783137930.535905:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137930.535907:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3dc00, rc 0) 00000100:00100000:2.0:1783137930.536040:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+40:11559:x1869755299485952:12345-192.168.202.24@tcp:101:bash.0 Request processed in 3457us (3685us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783137930.536047:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 199 00010000:00010000:3.0:1783137930.538848:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538881:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538889:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538895:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137930.538899:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538918:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538935:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5de2d1cb00) 00010000:00010000:3.0:1783137930.538938:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137930.538943:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.538948:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b7d8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.547508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.547584:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486080 00000100:00100000:2.0:1783137930.547594:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486080 00000100:00100000:2.0:1783137930.547667:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:2.0:1783137930.547680:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2353:x1869755299486080:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137930.547697:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137930.547717:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228ad expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137930.547744:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137930.547763:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1783137930.547767:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137930.547777:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 6 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.547795:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 6 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.547808:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d400, rc 0) 00000100:00100000:2.0:1783137930.547870:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2353:x1869755299486080:12345-192.168.202.24@tcp:101:bash.0 Request processed in 194us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.547891:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00080000:0.0:1783137930.549454:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137930.558625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.558739:0:7801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486208 00000100:00100000:2.0:1783137930.558750:0:7801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486208 00000100:00100000:2.0:1783137930.558815:0:7801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1783137930.558827:0:7801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+6:11559:x1869755299486208:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783137930.558846:0:7801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137930.558865:0:7801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228b4 expref: -99 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.558897:0:7801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.558921:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137930.558926:0:7801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137930.558931:0:7801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.558968:0:7801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.558983:0:7801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 7 pid: 6617 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.558998:0:7801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7801:1869755322549120:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137930.559125:0:7801:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137930.564442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137930.564601:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486336 00000100:00100000:0.0:1783137930.564620:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486336 00010000:00010000:0.0:1783137930.564668:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 8 pid: 6617 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.564710:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:0.0:1783137930.564720:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299486336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137930.564734:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137930.564756:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 8 pid: 6617 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.564770:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 8 pid: 6617 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.564798:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137930.564803:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137930.564827:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.564836:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.564874:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 8 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.564888:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322549248:192.168.202.24@tcp:105: 00000100:00100000:0.0:1783137930.564989:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab000 going to sleep for 11 seconds 00010000:00010000:2.0:1783137930.565457:0:7801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003016ee12/0x4691dfc3d66b7da3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ad expref: 8 pid: 6617 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.565475:0:7801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7801:1869755322549120:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137930.565498:0:7801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 7 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.565511:0:7801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3cc00, rc 0) 00000100:00100000:2.0:1783137930.565617:0:7801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75742c0b-74ec-412f-af86-0dbffc92280b+7:11559:x1869755299486208:12345-192.168.202.24@tcp:101:bash.0 Request processed in 6792us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.565633:0:7801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1783137930.572421:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1869755322549248:192.168.202.24@tcp:105: 00010000:00010000:2.0:1783137930.572452:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137930.572517:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299486336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7797us (8083us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.572529:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76 00000100:00100000:3.0:1783137930.581797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137930.581901:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486592 00000100:00100000:0.0:1783137930.581919:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486592 00000100:00100000:0.0:1783137930.581971:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:0.0:1783137930.581981:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+39:11559:x1869755299486592:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1783137930.582669:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+40:11559:x1869755299486592:12345-192.168.202.24@tcp:35:bash.0 Request processed in 687us (1134us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783137930.582678:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00010000:00010000:2.0:1783137930.747167:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137930.907337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137930.907502:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486720 00000100:00100000:1.0:1783137930.907512:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486720 00000100:00100000:1.0:1783137930.907621:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 200 00000100:00100000:1.0:1783137930.907633:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+40:11575:x1869755299486720:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137930.907658:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137930.907679:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228bb expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907746:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907761:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907788:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137930.907848:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1783137930.907852:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137930.907876:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907904:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228bb expref: 42 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907923:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228bb expref: 41 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.907932:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137930.907935:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137930.907940:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d600, rc 0) 00000100:00100000:1.0:1783137930.908011:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+41:11575:x1869755299486720:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 380us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137930.908018:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 200 00000100:00100000:1.0:1783137930.927382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.930341:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299486976 00000100:00100000:2.0:1783137930.930357:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299486976 00000100:00100000:2.0:1783137930.930434:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:2.0:1783137930.930445:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+41:11575:x1869755299486976:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137930.930465:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137930.930485:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7dbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228c2 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.930636:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.930666:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.930677:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137930.930690:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783137930.930819:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7dbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c2 expref: 44 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.930838:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c2 expref: 43 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.930847:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:2.0:1783137930.930849:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137930.930852:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3de00, rc 0) 00000100:00100000:2.0:1783137930.930935:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+43:11575:x1869755299486976:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 492us (3564us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783137930.930942:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 201 00000100:00100000:3.0:1783137930.937827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137930.937887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137930.937956:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299487360 00000100:00100000:1.0:1783137930.937968:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299487360 00000100:00100000:2.0:1783137930.938041:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299487232 00000100:00100000:2.0:1783137930.938047:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299487232 00000100:00100000:1.0:1783137930.938052:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1783137930.938075:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+44:2351:x1869755299487360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137930.938103:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783137930.938109:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 202 00000100:00100000:2.0:1783137930.938120:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+44:11575:x1869755299487232:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137930.938129:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b7dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c2 expref: 44 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.938141:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137930.938166:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:2.0:1783137930.938168:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7dd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137930.938171:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137930.938229:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+44:2351:x1869755299487360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 166us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137930.938237:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00010000:00010000:2.0:1783137930.938288:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.938303:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.938314:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137930.938327:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783137930.938456:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b7dd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c9 expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.938471:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c9 expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.938479:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:2.0:1783137930.938482:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137930.938484:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d000, rc 0) 00000100:00100000:2.0:1783137930.938527:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+44:11575:x1869755299487232:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 409us (711us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1783137930.938533:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 202 00000100:00100000:3.0:1783137930.939053:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322549504:0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.939211:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322549376:0@lo:400:kworker.0 00000100:00100000:2.0:1783137930.939297:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322549632:0@lo:400:kworker.0 00000100:00100000:1.0:1783137930.939367:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322549760:0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.941416:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137930.941474:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322549888:0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.941505:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137930.941565:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322549376 00000100:00100000:0.0:1783137930.941573:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322549376 00000100:00100000:0.0:1783137930.941678:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783137930.941686:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322549376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.941968:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322549376:12345-0@lo:400:kworker.0 Request processed in 280us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137930.941975:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783137930.942035:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322549376:0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.942058:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322549888 00000100:00100000:0.0:1783137930.942061:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322549888 00000100:00100000:0.0:1783137930.942408:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783137930.942416:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322549888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.942457:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322549888:12345-0@lo:400:kworker.0 Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137930.942464:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1783137930.942482:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137930.942503:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322549888:0@lo:400:kworker.0 00000100:00100000:2.0:1783137930.949748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137930.949822:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322549632 00000100:00100000:2.0:1783137930.949832:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322549632 00000100:00100000:2.0:1783137930.949922:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783137930.949934:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322549632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137930.950023:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322549632:12345-0@lo:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.950031:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783137930.950077:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322549632:0@lo:400:kworker.0 00000100:00080000:0.0:1783137930.950891:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137930.952577:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137930.952633:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322550016:0@lo:400:kworker.0 00000100:00100000:3.0:1783137930.952684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137930.953015:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322549504 00000100:00100000:0.0:1783137930.953024:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322549504 00000100:00100000:0.0:1783137930.953077:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783137930.953199:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322549504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137930.953259:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322549504:12345-0@lo:400:kworker.0 Request processed in 174us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137930.953267:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783137930.953401:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322550016 00000100:00100000:2.0:1783137930.953406:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322550016 00000100:00100000:2.0:1783137930.953453:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783137930.953461:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322550016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137930.953498:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322550016:12345-0@lo:400:kworker.0 Request processed in 38us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137930.953505:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783137930.953598:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322549504:0@lo:400:kworker.0 00000100:00100000:3.0:1783137930.953609:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322550016:0@lo:400:kworker.0 00000100:00080000:0.0:1783137930.953720:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137930.956710:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137930.957807:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322549760 00000100:00100000:1.0:1783137930.957819:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322549760 00000100:00100000:1.0:1783137930.957894:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783137930.957905:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322549760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137930.957984:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322549760:12345-0@lo:400:kworker.0 Request processed in 81us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137930.957990:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1783137930.959059:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137930.959119:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322549760:0@lo:400:kworker.0 00000100:00100000:3.0:1783137930.965436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.965891:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299487488 00000100:00100000:2.0:1783137930.965902:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299487488 00000100:00100000:2.0:1783137930.965955:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1783137930.965964:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+6:2352:x1869755299487488:12345-192.168.202.24@tcp:1:lfs.0 00010000:00010000:2.0:1783137930.966023:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.966044:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 6 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.966053:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137930.966056:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137930.966060:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.966136:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 6 pid: 7801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137930.966150:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 6 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137930.966165:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6616:1869755322550144:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137930.966257:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137930.977830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137930.977954:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6616:1869755322550144:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137930.977982:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137930.978064:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299487616 00000100:00100000:3.0:1783137930.978071:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299487616 00002000:00100000:3.0:1783137930.978137:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e5dc5c56300 x1869755299487616/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:81/0 lens 504/0 e 0 to 0 dl 1783137941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137930.978147:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dc5c56300 with x1869755299487616 ext(0->8) 00010000:00010000:3.0:1783137930.978155:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 7 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.978169:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 7 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137930.978175:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dc5c56300 00000100:00100000:3.0:1783137930.978209:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1783137930.978218:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299487616:12345-192.168.202.24@tcp:4:lfs.0 00000100:00100000:3.0:1783137930.978843:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:2351:x1869755299487616:12345-192.168.202.24@tcp:4:lfs.0 Request processed in 624us (1021us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783137930.978852:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00002000:00100000:3.0:1783137930.978860:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e5dc5c56300 x1869755299487616/t4294967308(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:81/0 lens 504/448 e 0 to 0 dl 1783137941 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137930.978868:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dc5c56300 with x1869755299487616 ext(0->8) 00010000:00010000:3.0:1783137930.978880:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.978893:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137930.978902:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e5dc5c56300 00000100:00100000:1.0:1783137930.993774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137930.993885:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299487744 00000100:00100000:0.0:1783137930.993909:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299487744 00010000:00010000:0.0:1783137930.993953:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137930.994018:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:0.0:1783137930.994029:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299487744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137930.994045:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783137930.994078:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783137930.994081:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783137929 00002000:00010000:0.0:1783137930.994083:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783137930 00002000:00010000:0.0:1783137930.994085:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783137929 00010000:00010000:0.0:1783137930.994101:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.994115:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.994138:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c8a78b5/0x4691dfc3d66b7daa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228b4 expref: 9 pid: 7801 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.994156:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137930.994160:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137930.994166:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.994176:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137930.994227:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137930.994505:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299487744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 476us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137930.994526:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00010000:00010000:3.0:1783137930.994715:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994726:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994753:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994762:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994770:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994777:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783137930.994781:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994790:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994811:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137930.994818:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000663e322b/0x4691dfc3d66b7de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137930.994867:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299487488:12345-192.168.202.24@tcp:1:lfs.0 Request processed in 28904us (29440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137930.994876:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:0.0:1783137930.999639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.001057:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488000 00000100:00100000:3.0:1783137931.001071:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488000 00000100:00100000:3.0:1783137931.001171:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:3.0:1783137931.001183:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6707850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+44:11575:x1869755299488000:12345-192.168.202.24@tcp:35:lfs.0 00000004:00010000:3.0:1783137931.001262:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c9 expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137931.001540:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1783137931.001614:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1783137931.001947:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1783137931.002014:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.002030:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.002040:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.002094:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.002110:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 48 pid: 5812 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137931.002126:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322550272:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137931.002206:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd0b73a80 going to sleep for 11 seconds 00000100:00080000:0.0:1783137931.002435:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137931.015920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.016356:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1869755322550272:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137931.016385:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137931.016401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488128 00000100:00100000:2.0:1783137931.016409:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488128 00010000:00010000:2.0:1783137931.016448:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 49 pid: 5812 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137931.016490:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:2.0:1783137931.016499:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+49:2351:x1869755299488128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137931.016513:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137931.016520:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 49 pid: 5812 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016532:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 49 pid: 5812 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016617:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7d95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228a6 expref: 49 pid: 5812 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016633:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:2.0:1783137931.016638:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016648:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016655:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.016689:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137931.016814:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.016823:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137931.016966:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783137931.017216:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1783137931.017497:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322550400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137931.017608:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137931.017637:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137931.017655:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322550400 00000100:00100000:0.0:1783137931.017660:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322550400 00000100:00100000:2.0:1783137931.017912:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+50:2351:x1869755299488128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1411us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137931.017921:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:0.0:1783137931.018045:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137931.018059:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322550400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137931.018151:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1869755322550400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.018212:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322550400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137931.018772:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1783137931.018830:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322550528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137931.018861:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137931.018874:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137931.029309:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783137931.029328:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783137931.032569:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322550528 00000100:00100000:3.0:1783137931.032582:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322550528 00000100:00100000:2.0:1783137931.032803:0:12413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783137931.032814:0:12413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5814:x1869755322550528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783137931.033112:0:12413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5814:x1869755322550528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 300us (14248us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783137931.033121:0:12413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137931.033348:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1869755322550528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783137931.033421:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1783137931.033469:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033479:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033499:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033505:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137931.033509:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033517:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033533:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:3.0:1783137931.033536:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783137931.033572:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.033580:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7df0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137931.033790:0:5814:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783137931.033883:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1783137931.033894:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420926349049ns, next at 421926346818ns, rc = 0 00000001:00080000:3.0:1783137931.033900:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1783137931.033933:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1c800) 00010000:00010000:3.0:1783137931.033937:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783137931.033944:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d000/0x4691dfc3d66b7ddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228c9 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137931.034196:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6707850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+51:11575:x1869755299488000:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 33015us (34568us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1783137931.034215:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000020:00080000:3.0:1783137931.034220:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783137931.036397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137931.046874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137931.047328:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488256 00000100:00100000:2.0:1783137931.047339:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488256 00000100:00100000:2.0:1783137931.047401:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:2.0:1783137931.047412:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+51:11575:x1869755299488256:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783137931.047453:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137931.047476:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7df7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228d0 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.047536:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d0 expref: 52 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.047578:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d0 expref: 52 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.047600:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137931.047603:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137931.047607:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d400, rc 0) 00000100:00100000:2.0:1783137931.047660:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+52:11575:x1869755299488256:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 251us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137931.047680:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 203 00000100:00100000:1.0:1783137931.051664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.051748:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488512 00000100:00100000:3.0:1783137931.051760:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488512 00000100:00100000:3.0:1783137931.051821:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1783137931.051842:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+52:11575:x1869755299488512:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1783137931.052140:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+53:11575:x1869755299488512:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 308us (484us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1783137931.052156:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:0.0:1783137931.239384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137931.239503:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488640 00000100:00100000:1.0:1783137931.239514:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488640 00000100:00100000:1.0:1783137931.239693:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 204 00000100:00100000:1.0:1783137931.239705:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:11585:x1869755299488640:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:1.0:1783137931.239792:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.239831:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.239844:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.239862:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.239869:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.239876:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240242:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240251:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240259:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137931.240300:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240313:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240319:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240336:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240342:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137931.240346:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240353:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240366:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137931.240369:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137931.240374:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240380:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c600/0x4691dfc3d66b7dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240393:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240400:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240405:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240411:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137931.240414:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240430:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240439:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc5113200) 00010000:00010000:1.0:1783137931.240442:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137931.240445:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240451:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7e05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240466:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240472:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240477:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240482:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137931.240485:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240491:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240497:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137931.240499:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137931.240502:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.240517:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137931.240878:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+53:11585:x1869755299488640:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 1173us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137931.240887:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 204 00000100:00100000:1.0:1783137931.324310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.324406:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299488896 00000100:00100000:3.0:1783137931.324416:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299488896 00000100:00100000:3.0:1783137931.324478:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:3.0:1783137931.324488:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+53:11588:x1869755299488896:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137931.324509:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137931.324528:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324652:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324667:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324678:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324691:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324712:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324718:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324847:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7e28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324855:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.324863:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137931.324872:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783137931.325334:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325343:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325350:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325356:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137931.325360:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325368:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325393:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137931.325395:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137931.325400:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325405:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7e1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325421:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325428:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325434:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325439:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137931.325442:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325447:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325454:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dc39a2300) 00010000:00010000:3.0:1783137931.325456:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137931.325459:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325465:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325519:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d7 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325532:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7e28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d7 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.325538:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137931.325540:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137931.325642:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7000, rc 0) 00000100:00100000:3.0:1783137931.325757:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:11588:x1869755299488896:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1269us (1455us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1783137931.325765:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 205 00000100:00100000:1.0:1783137931.339458:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.339621:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299489024 00000100:00100000:3.0:1783137931.339631:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299489024 00000100:00100000:3.0:1783137931.339691:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:3.0:1783137931.339701:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+55:11588:x1869755299489024:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:3.0:1783137931.339769:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339785:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339797:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339822:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339848:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339854:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339860:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137931.339864:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339871:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339884:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137931.339888:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137931.339891:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.339897:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137931.340336:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+55:11588:x1869755299489024:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 636us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.340344:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 206 00000100:00100000:1.0:1783137931.346814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137931.346918:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299489280 00000100:00100000:0.0:1783137931.346930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299489280 00000100:00100000:0.0:1783137931.347010:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1783137931.347020:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+55:11588:x1869755299489280:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783137931.347268:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0110ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+56:11588:x1869755299489280:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 247us (462us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783137931.347276:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:3.0:1783137931.450822:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137931.450846:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322550656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137931.450933:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137931.451118:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322550656 00000100:00100000:1.0:1783137931.451126:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322550656 00000100:00100000:1.0:1783137931.451179:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137931.451189:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322550656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137931.451224:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137931.451277:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322550656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137931.451284:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783137931.451429:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322550656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137931.513055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137931.513263:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299489536 00000100:00100000:0.0:1783137931.513274:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299489536 00000100:00100000:0.0:1783137931.513331:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:0.0:1783137931.513342:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+56:11598:x1869755299489536:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783137931.513367:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137931.513370:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783137931.513398:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d600/0x4691dfc3d66b7db8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228bb expref: 56 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513417:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137931.513422:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137931.513435:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7e3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228de expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513532:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513596:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513607:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137931.513630:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783137931.513760:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7e3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228de expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513778:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228de expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.513785:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:0.0:1783137931.513788:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137931.513790:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044400, rc 0) 00000100:00100000:0.0:1783137931.513852:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc4204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+57:11598:x1869755299489536:12345-192.168.202.24@tcp:101:bash.0 Request processed in 512us (807us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1783137931.513859:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 207 00000100:00100000:1.0:1783137931.519179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137931.519273:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299489792 00000100:00100000:2.0:1783137931.519283:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299489792 00000100:00100000:2.0:1783137931.519339:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 208 00000100:00100000:2.0:1783137931.519350:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+57:11598:x1869755299489792:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:2.0:1783137931.519406:0:11954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783137931.519432:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228de expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.519455:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7000/0x4691dfc3d66b7e28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d7 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.519486:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137931.519490:0:11954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137931.519731:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.519745:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.519755:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137931.519806:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1783137931.519838:0:11954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc1dbcd9 reply state 000000008c7d059c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137931.519847:0:11954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137931.519930:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+58:11598:x1869755299489792:12345-192.168.202.24@tcp:36:bash.0 Request processed in 581us (761us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783137931.519937:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 208 00000020:00080000:2.0:1783137931.519942:0:11954:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137931.529756:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529775:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529784:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529791:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137931.529811:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529821:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529837:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137931.529853:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137931.529858:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.529865:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7e52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137931.530183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.530324:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299489920 00000100:00100000:3.0:1783137931.530335:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299489920 00000100:00100000:3.0:1783137931.530395:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:3.0:1783137931.530413:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+57:11598:x1869755299489920:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783137931.530437:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137931.530453:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228e5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530533:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530628:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530640:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137931.530670:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783137931.530675:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137931.530694:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530717:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530733:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.530740:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137931.530742:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137931.530745:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6e00, rc 0) 00000100:00100000:3.0:1783137931.530807:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+58:11598:x1869755299489920:12345-192.168.202.24@tcp:101:bash.0 Request processed in 396us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.530822:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 209 00000100:00100000:1.0:1783137931.534083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137931.542713:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490176 00000100:00100000:0.0:1783137931.542728:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490176 00000100:00100000:0.0:1783137931.542812:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:0.0:1783137931.542822:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+58:11598:x1869755299490176:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1783137931.543288:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+59:11598:x1869755299490176:12345-192.168.202.24@tcp:35:bash.0 Request processed in 466us (9212us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783137931.543296:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:1.0:1783137931.707150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.707230:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490304 00000100:00100000:3.0:1783137931.707241:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490304 00000100:00100000:3.0:1783137931.707297:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 210 00000100:00100000:3.0:1783137931.707308:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+59:11604:x1869755299490304:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137931.707331:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137931.707352:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228ec expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707415:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707429:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707440:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137931.707501:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783137931.707505:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137931.707530:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707586:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ec expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707617:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ec expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.707645:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:3.0:1783137931.707649:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137931.707652:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6800, rc 0) 00000100:00100000:3.0:1783137931.707713:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd8030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299490304:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 407us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.707719:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 210 00000100:00100000:1.0:1783137931.720889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137931.720986:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490432 00000100:00100000:0.0:1783137931.721005:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490432 00000100:00100000:0.0:1783137931.721063:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:0.0:1783137931.721073:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299490432:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137931.721100:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137931.721131:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7e75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228f3 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721188:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721201:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721211:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721222:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721229:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721234:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721334:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721343:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721351:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137931.721385:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783137931.721389:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137931.721406:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721423:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721431:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721437:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721443:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721449:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137931.721453:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721460:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721472:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137931.721475:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137931.721479:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721485:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7e7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721500:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721507:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721519:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721524:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137931.721528:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.721534:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.722774:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137931.722781:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137931.722788:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.722797:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.722842:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7e75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228f3 expref: 62 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.722856:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228f3 expref: 61 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.722864:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:0.0:1783137931.722866:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137931.722869:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045400, rc 0) 00000100:00100000:0.0:1783137931.722935:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+61:11604:x1869755299490432:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1862us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137931.722956:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 211 00000100:00100000:1.0:1783137931.727027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137931.727068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.727203:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490816 00000100:00100000:3.0:1783137931.727213:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490816 00000100:00100000:3.0:1783137931.727277:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1783137931.727286:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+61:2350:x1869755299490816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137931.727302:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137931.727330:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7e8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228f3 expref: 61 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.727350:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137931.727356:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137931.727404:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+60:2350:x1869755299490816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.727412:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783137931.727947:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490688 00000100:00100000:0.0:1783137931.727953:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490688 00000100:00100000:0.0:1783137931.727983:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:0.0:1783137931.728001:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299490688:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137931.728017:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137931.728031:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7e91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239228fa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.728135:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.728149:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.728157:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.728187:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.728199:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 61 pid: 5812 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137931.728213:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322550784:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783137931.728285:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14aca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137931.735060:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1869755322550784:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137931.735118:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137931.745849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137931.746125:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299490944 00000100:00100000:2.0:1783137931.746135:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299490944 00010000:00010000:2.0:1783137931.746176:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 62 pid: 5812 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137931.746218:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:2.0:1783137931.746228:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+62:2352:x1869755299490944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137931.746241:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137931.746248:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 62 pid: 5812 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746262:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 62 pid: 5812 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746284:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6e00/0x4691dfc3d66b7e60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228e5 expref: 62 pid: 5812 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746325:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137931.746330:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746340:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746349:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.746385:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137931.746439:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+61:2352:x1869755299490944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 213us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137931.746447:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00010000:00010000:0.0:1783137931.746640:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.746648:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137931.746666:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783137931.746805:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7e91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.746823:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137931.746830:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:0.0:1783137931.746833:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137931.746835:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044400, rc 0) 00000100:00100000:0.0:1783137931.746861:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+61:11604:x1869755299490688:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 18871us (19843us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1783137931.746869:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 212 00000100:00100000:1.0:1783137931.750739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137931.750932:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491200 00000100:00100000:3.0:1783137931.750942:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491200 00000100:00100000:3.0:1783137931.751009:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1783137931.751020:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+61:11604:x1869755299491200:12345-192.168.202.24@tcp:103:lfs.0 00010000:00010000:3.0:1783137931.751036:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137931.751059:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7df7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228d0 expref: 61 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137931.751083:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137931.751088:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137931.751166:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299491200:12345-192.168.202.24@tcp:103:lfs.0 Request processed in 147us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137931.751173:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1783137931.754294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137931.754375:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491328 00000100:00100000:2.0:1783137931.754384:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491328 00000100:00100000:2.0:1783137931.754443:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 213 00000100:00100000:2.0:1783137931.754453:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299491328:12345-192.168.202.24@tcp:58:lfs.0 00010000:00010000:2.0:1783137931.754583:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.754600:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137931.754621:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137931.754811:0:11954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783137931.754900:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299491328:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 446us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137931.754920:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 213 00000100:00100000:0.0:1783137931.759583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137931.759708:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491456 00000100:00100000:1.0:1783137931.759719:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491456 00000100:00100000:1.0:1783137931.759778:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 214 00000100:00100000:1.0:1783137931.759788:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+60:11604:x1869755299491456:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1783137931.759808:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137931.759830:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922901 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759888:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759899:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 61 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759927:0:7189:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759942:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 61 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759956:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137931.759959:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137931.759963:0:7189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 61 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137931.759970:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6ca00, rc 0) 00000100:00100000:1.0:1783137931.760046:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+61:11604:x1869755299491456:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 259us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137931.760070:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 214 00010000:00010000:1.0:1783137931.771468:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783137932.029814:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1783137932.029851:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1783137932.030207:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1783137932.030227:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5dd0b739c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783137932.030232:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5e0131f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dd0b73a80 00000020:00080000:1.0:1783137932.030236:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5e0131f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5dea320400 00000020:00080000:1.0:1783137932.030268:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5cc2412b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783137932.030272:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dc5770600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5cc2412480 00000020:00080000:1.0:1783137932.030274:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dc5770900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5cc2900000 00000020:00080000:1.0:1783137932.030393:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783137932.030586:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783137932.030605:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322550912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783137932.030672:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137932.030747:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322550912 00000100:00100000:1.0:1783137932.030755:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322550912 00000100:00100000:1.0:1783137932.030809:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783137932.030819:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1869755322550912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783137932.030845:0:6615:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1783137932.030876:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a488689, atime: 0x6a48868a, ctime: 0x6a488689, blocks: 0x1 00010000:00010000:1.0:1783137932.030884:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.030900:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=421s v=(0 0) 00000100:00100000:2.0:1783137932.031285:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322551040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783137932.031318:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137932.031354:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322551040 00000100:00100000:2.0:1783137932.031357:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322551040 00000100:00100000:2.0:1783137932.031386:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783137932.031393:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322551040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783137932.031406:0:6617:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1783137932.031421:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.031435:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.031443:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783137932.031447:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137932.031451:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.031477:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.031490:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 8 pid: 6615 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.031502:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfa392680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322551168:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137932.031587:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137932.034926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1783137932.035124:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137932.035134:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.035156:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.035169:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.035177:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.035193:0:6615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783137932.035736:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfa392680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6617:1869755322551168:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137932.035760:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.035788:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491584 00000100:00100000:2.0:1783137932.035793:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491584 00010000:00010000:2.0:1783137932.035827:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 9 pid: 6615 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.035860:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:2.0:1783137932.035871:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299491584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137932.035884:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137932.035890:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 9 pid: 6615 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.035913:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 9 pid: 6615 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.035935:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007acfcbcb/0x4691dfc3d66b7cfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922891 expref: 9 pid: 6615 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.035949:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137932.035953:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137932.035958:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.035973:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036004:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137932.036053:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299491584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 183us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.036061:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00010000:00010000:2.0:1783137932.036113:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036122:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036130:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036138:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036153:0:6617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783137932.036571:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322551040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5176us (5250us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783137932.036579:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:2.0:1783137932.036599:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137932.036619:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036634:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137932.036638:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036647:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036660:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036666:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ad73420/0x4691dfc3d66b7eb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036684:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137932.036688:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036693:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137932.036696:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036702:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036710:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036722:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006402a90/0x4691dfc3d66b7ebb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.036734:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137932.036736:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137932.036738:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783137932.036768:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5df5e5ad80/2, rc 0, transno 4294967319 00000100:00100000:2.0:1783137932.036774:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322551040:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783137932.037571:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783137932.039236:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137932.039245:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137932.039541:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc8778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1869755322550912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8719us (8864us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783137932.039566:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1783137932.039694:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5df594d880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783137932.039702:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322550912:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1783137932.410831:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137932.410840:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137932.410895:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1783137932.410901:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783137932.411037:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58e9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322551296:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783137932.411209:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137932.416808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.416881:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491712 00000100:00100000:2.0:1783137932.416899:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491712 00000100:00100000:2.0:1783137932.416962:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:2.0:1783137932.416972:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299491712:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137932.417015:0:5813:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137932.417168:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299491712:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.417176:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 215 00000100:00100000:0.0:1783137932.417378:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58e9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322551296:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783137932.426792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.426895:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299491840 00000100:00100000:3.0:1783137932.426905:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299491840 00000100:00100000:3.0:1783137932.426967:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:3.0:1783137932.426978:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:11605:x1869755299491840:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783137932.427066:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427090:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427103:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427157:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427166:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427173:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427218:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427227:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427234:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137932.427271:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783137932.427275:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137932.427286:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427297:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427303:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427309:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427315:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.427318:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427325:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427335:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137932.427344:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137932.427348:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427354:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7ec2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427369:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427375:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427381:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427501:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.427504:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427510:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427519:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e5dc39a2600) 00010000:00010000:3.0:1783137932.427521:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137932.427524:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427529:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ec9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427593:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427609:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427615:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427620:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.427624:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427630:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427638:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137932.427641:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137932.427644:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.427649:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.427735:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:11605:x1869755299491840:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 757us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.427743:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 216 00000100:00100000:1.0:1783137932.447007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.447175:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299492096 00000100:00100000:3.0:1783137932.447185:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299492096 00000100:00100000:3.0:1783137932.447240:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:3.0:1783137932.447249:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11605:x1869755299492096:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137932.447269:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137932.447300:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922908 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447409:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447423:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447435:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137932.447446:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783137932.447821:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447830:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447837:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447843:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.447847:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447855:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447868:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137932.447871:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783137932.447876:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447903:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7ede lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447947:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922908 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447958:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:3.0:1783137932.447960:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137932.447964:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7ed7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922908 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.447974:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6c00, rc 0) 00000100:00100000:3.0:1783137932.448072:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492096:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 823us (1084us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1783137932.448080:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 217 00000100:00100000:0.0:1783137932.461845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.462195:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299492224 00000100:00100000:3.0:1783137932.462205:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299492224 00000100:00100000:3.0:1783137932.462265:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:3.0:1783137932.462275:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492224:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783137932.462311:0:11954:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783137932.462471:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492224:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 197us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.462478:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 218 00000100:00100000:1.0:1783137932.491441:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.491636:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299492480 00000100:00100000:0.0:1783137932.491646:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299492480 00000100:00100000:0.0:1783137932.491698:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:0.0:1783137932.491709:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492480:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137932.491730:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137932.491733:0:7189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783137932.491760:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6800/0x4691dfc3d66b7e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228ec expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.491782:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137932.491787:0:7189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137932.491800:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7eec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392290f expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137932.492609:0:7189:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1783137932.492871:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7ef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.492885:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.492895:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.492963:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7eec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392290f expref: 22 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.492981:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392290f expref: 21 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.492998:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137932.493001:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137932.493003:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044000, rc 0) 00000100:00100000:0.0:1783137932.493067:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299492480:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1634us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1783137932.493075:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219 00000100:00100000:1.0:1783137932.510661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.512440:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299492736 00000100:00100000:0.0:1783137932.512455:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299492736 00000100:00100000:0.0:1783137932.512522:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:0.0:1783137932.512534:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299492736:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137932.512635:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137932.512661:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7ef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392290f expref: 21 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512682:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dcc9ec900) 00010000:00010000:0.0:1783137932.512692:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137932.512711:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512724:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512743:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512758:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512766:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.512773:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513384:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513395:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513401:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513408:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137932.513412:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513420:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513431:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:0.0:1783137932.513434:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137932.513438:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513451:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513463:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513468:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513474:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513478:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137932.513481:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513486:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513494:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfa73337b (ffff8e5dcc9ec100) 00010000:00010000:0.0:1783137932.513497:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137932.513499:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.513504:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfa73337b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.515107:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492736:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 2567us (4447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137932.515119:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 220 00000100:00100000:2.0:1783137932.531795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.532512:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299492864 00000100:00100000:3.0:1783137932.532523:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299492864 00000100:00100000:3.0:1783137932.532601:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:3.0:1783137932.532627:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299492864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137932.532645:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137932.532668:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922916 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532703:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532718:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532729:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532821:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532843:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.532852:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:3.0:1783137932.532855:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783137932.532859:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6600, rc 0) 00000100:00100000:3.0:1783137932.532931:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299492864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 306us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.532939:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 221 00000100:00100000:2.0:1783137932.538876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.539184:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299493120 00000100:00100000:3.0:1783137932.539194:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299493120 00000100:00100000:3.0:1783137932.539262:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:3.0:1783137932.539286:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfa391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299493120:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137932.539372:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.539388:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.539400:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137932.539698:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1783137932.539709:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422432163135ns, next at 423432160790ns, rc = 0 00000004:00010000:3.0:1783137932.539792:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e17cae07 reply state 0000000002802c8f transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.539802:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137932.539890:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfa391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+23:11605:x1869755299493120:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 605us (1022us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783137932.539897:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 222 00000100:00100000:3.0:1783137932.544842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.544967:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299493248 00000100:00100000:0.0:1783137932.544978:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299493248 00000100:00100000:0.0:1783137932.545252:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 223 00000100:00100000:0.0:1783137932.545264:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+23:11605:x1869755299493248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137932.545286:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137932.545305:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392291d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.545362:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.545378:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.545398:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:0.0:1783137932.545401:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137932.545405:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044200, rc 0) 00000100:00100000:0.0:1783137932.545470:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299493248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 208us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137932.545476:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 223 00010000:00010000:2.0:1783137932.546955:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.546968:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.547003:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.547010:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137932.547014:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.547022:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.547036:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:2.0:1783137932.547039:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137932.547042:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.547048:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b7f1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.548893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.549256:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299493376 00000100:00100000:2.0:1783137932.549267:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299493376 00000100:00100000:2.0:1783137932.549330:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:2.0:1783137932.549340:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2351:x1869755299493376:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783137932.549705:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2351:x1869755299493376:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 365us (818us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783137932.549713:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000001:00080000:1.0:1783137932.552171:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1783137932.552188:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1783137932.552194:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1783137932.552198:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:3.0:1783137932.555679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.555783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299493632 00000100:00100000:2.0:1783137932.555792:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299493632 00000100:00100000:2.0:1783137932.555839:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1783137932.555849:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+23:11605:x1869755299493632:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783137932.556103:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299493632:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 255us (431us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783137932.556111:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:2.0:1783137932.558489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.558589:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299493888 00000100:00100000:0.0:1783137932.558597:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299493888 00000100:00100000:0.0:1783137932.558659:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 224 00000100:00100000:0.0:1783137932.558668:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299493888:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137932.558766:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299493888:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 99us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137932.558774:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 224 00000100:00100000:3.0:1783137932.561680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.561782:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494016 00000100:00100000:0.0:1783137932.561790:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494016 00000100:00100000:0.0:1783137932.561851:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 225 00000100:00100000:0.0:1783137932.561861:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299494016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137932.561881:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137932.561901:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922924 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.561967:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.561982:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.562004:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137932.562040:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137932.562057:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.562082:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922924 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.562113:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922924 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.562122:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:0.0:1783137932.562124:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783137932.562127:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044000, rc 0) 00000100:00100000:0.0:1783137932.562200:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+25:11605:x1869755299494016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 341us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137932.562206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 225 00000100:00100000:3.0:1783137932.565456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.565584:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494144 00000100:00100000:1.0:1783137932.565592:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494144 00000100:00100000:1.0:1783137932.565659:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:1.0:1783137932.565685:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299494144:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137932.565701:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137932.565720:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392292b expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137932.565744:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48868b, blocks: 0x1 00010000:00010000:1.0:1783137932.565762:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1783137932.565766:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137932.565776:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.565794:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.565807:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d800, rc 0) 00000100:00100000:1.0:1783137932.565861:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299494144:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 179us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137932.565868:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:2.0:1783137932.569060:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.569168:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494400 00000100:00100000:0.0:1783137932.569177:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494400 00000100:00100000:0.0:1783137932.569233:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:0.0:1783137932.569252:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+25:11605:x1869755299494400:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137932.569358:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc23c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+25:11605:x1869755299494400:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 116us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137932.569365:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 226 00000100:00100000:0.0:1783137932.572680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.572770:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494528 00000100:00100000:2.0:1783137932.572779:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494528 00000100:00100000:2.0:1783137932.572833:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:2.0:1783137932.572843:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:11605:x1869755299494528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137932.572861:0:6616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137932.572878:0:6616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922932 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.572911:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.572920:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137932.572924:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137932.572928:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 9 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.572962:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.572975:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.573021:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322551424:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137932.573120:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb1876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137932.576442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.576630:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc216ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322551424:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783137932.576663:0:6616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 9 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.576683:0:6616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c000, rc 0) 00000100:00100000:2.0:1783137932.576743:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:11605:x1869755299494528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 3901us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.576752:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:0.0:1783137932.577367:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494656 00000100:00100000:0.0:1783137932.577375:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494656 00010000:00010000:0.0:1783137932.577407:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.577441:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:0.0:1783137932.577451:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+9:2353:x1869755299494656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137932.577465:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137932.577485:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.577498:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.577519:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b7f39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392292b expref: 9 pid: 6615 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.577574:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137932.577579:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137932.577588:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.577598:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.577636:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.577649:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1869755322551552:192.168.202.24@tcp:105: 00000100:00100000:0.0:1783137932.577714:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137932.581702:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1869755322551552:192.168.202.24@tcp:105: 00010000:00010000:0.0:1783137932.581729:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137932.581788:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75742c0b-74ec-412f-af86-0dbffc92280b+8:2353:x1869755299494656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4338us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137932.581800:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:2.0:1783137932.586323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.586472:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494784 00000100:00100000:0.0:1783137932.586481:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494784 00002000:00100000:0.0:1783137932.586529:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e5cc216ca80 x1869755299494784/t0(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:83/0 lens 504/0 e 0 to 0 dl 1783137943 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137932.586541:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5cc216ca80 with x1869755299494784 ext(0->12) 00002000:00010000:0.0:1783137932.586587:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5cc216ca80 00000100:00100000:0.0:1783137932.586635:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783137932.586645:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299494784:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783137932.587109:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc216ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75742c0b-74ec-412f-af86-0dbffc92280b+10:2352:x1869755299494784:12345-192.168.202.24@tcp:4:lhsmtool_posix.0 Request processed in 462us (795us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783137932.587118:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00002000:00100000:0.0:1783137932.587125:0:6620:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e5cc216ca80 x1869755299494784/t4294967321(0) o4->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:83/0 lens 504/448 e 0 to 0 dl 1783137943 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137932.587135:0:6620:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5cc216ca80 with x1869755299494784 ext(0->12) 00002000:00010000:0.0:1783137932.587138:0:6620:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5cc216ca80 00000100:00100000:3.0:1783137932.590174:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.590281:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299494912 00000100:00100000:2.0:1783137932.590290:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299494912 00000100:00100000:2.0:1783137932.590346:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00100000:2.0:1783137932.590356:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+25:11605:x1869755299494912:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783137932.627233:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000020:00080000:3.0:1783137932.627260:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1783137932.627275:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1783137932.627297:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1783137932.627426:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322551680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783137932.627505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783137932.627783:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1783137932.627799:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1783137932.627864:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322551680 00000100:00100000:3.0:1783137932.627872:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322551680 00000100:00100000:3.0:1783137932.627912:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137932.627921:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322551680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783137932.628165:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783137932.628169:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783137931 00002000:00010000:3.0:1783137932.628171:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783137932.628173:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783137931 -> 1783137931 00002000:00010000:3.0:1783137932.628175:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783137932.628218:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869755322551680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (711us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783137932.628225:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137932.628482:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000004:00080000:3.0:1783137932.628488:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967319 00000004:00080000:3.0:1783137932.628506:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5df5e5ad80, transno 4294967319 00000100:00100000:3.0:1783137932.628829:0:3314:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e5df5f7d880 x1869755322551680/t4294967322(4294967322) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783137948 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783137932.628842:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5df5f7d880/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783137932.629022:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299494912:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 38664us (38853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.629031:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 227 00000100:00100000:3.0:1783137932.632395:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322551680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783137932.632525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.632669:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495040 00000100:00100000:3.0:1783137932.632678:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495040 00000100:00100000:3.0:1783137932.632729:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:3.0:1783137932.632738:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+10:2352:x1869755299495040:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783137932.668071:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1783137932.668106:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:3.0:1783137932.668364:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299495040:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 35620us (35834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.668375:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:3.0:1783137932.671852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.671925:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495296 00000100:00100000:0.0:1783137932.671934:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495296 00000100:00100000:0.0:1783137932.672000:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:0.0:1783137932.672011:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299495296:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137932.672065:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137932.672104:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922924 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.672124:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:0.0:1783137932.672129:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137932.672159:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.672173:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.672202:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137932.673479:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e83e8620 reply state 00000000ad353047 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.673493:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137932.674004:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+22:11605:x1869755299495296:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1992us (2158us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1783137932.674013:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 228 00000100:00100000:3.0:1783137932.679903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.679998:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495424 00000100:00100000:0.0:1783137932.680008:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495424 00000100:00100000:0.0:1783137932.680066:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:0.0:1783137932.680076:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2353:x1869755299495424:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783137932.680349:0:6615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783137932.680353:0:6615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783137931 -> 1783137930 00002000:00010000:0.0:1783137932.680355:0:6615:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783137930 00002000:00010000:0.0:1783137932.680357:0:6615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783137931 -> 1783137930 00002000:00010000:0.0:1783137932.680358:0:6615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783137932.680410:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2353:x1869755299495424:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 335us (516us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1783137932.680417:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00010000:00010000:1.0:1783137932.680803:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680814:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680822:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680828:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783137932.680845:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680854:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680870:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:1.0:1783137932.680873:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137932.680878:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.680884:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044e00/0x4691dfc3d66b7f47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137932.685411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.685507:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495680 00000100:00100000:2.0:1783137932.685788:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495680 00000100:00100000:2.0:1783137932.685848:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00100000:2.0:1783137932.685867:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+21:11605:x1869755299495680:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783137932.685933:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.685949:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.685958:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.686002:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.686017:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 21 pid: 5812 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.686031:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322551808:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137932.686160:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb1879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137932.690470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.690601:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df594c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322551808:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783137932.690639:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.691464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495808 00000100:00100000:3.0:1783137932.691474:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495808 00010000:00010000:3.0:1783137932.691512:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 22 pid: 5812 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.691817:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:3.0:1783137932.691828:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:2352:x1869755299495808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137932.691844:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137932.691852:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 22 pid: 5812 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691864:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 22 pid: 5812 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691898:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7f16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922916 expref: 22 pid: 5812 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691916:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:3.0:1783137932.691920:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691929:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691948:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.691978:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137932.692072:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:2352:x1869755299495808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 246us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.692089:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00010000:00010000:0.0:1783137932.692141:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692149:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692177:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692184:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692191:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692196:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137932.692201:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692208:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692217:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:0.0:1783137932.692219:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783137932.692223:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.692229:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d200/0x4691dfc3d66b7f4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.692283:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299495680:12345-192.168.202.24@tcp:55:lhsmtool_posix.0 Request processed in 6418us (6881us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783137932.692297:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 229 00000100:00100000:1.0:1783137932.697416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.697736:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299495936 00000100:00100000:2.0:1783137932.697746:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299495936 00000100:00100000:2.0:1783137932.697800:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1783137932.697810:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2350:x1869755299495936:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783137932.697852:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.697871:0:6616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.697903:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137932.697908:0:6616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137932.697912:0:6616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.697947:0:6616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.697960:0:6616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.697975:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322551936:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783137932.698063:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb1876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137932.701796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.701866:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299496064 00000100:00100000:1.0:1783137932.701875:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299496064 00010000:00010000:1.0:1783137932.701925:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 9 pid: 6616 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137932.701968:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:1.0:1783137932.701978:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299496064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137932.702004:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137932.702026:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 9 pid: 6616 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.702042:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 9 pid: 6616 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.702096:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137932.702101:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137932.702107:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.702117:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.702138:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137932.702185:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+9:2352:x1869755299496064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 208us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137932.702193:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00010000:00010000:3.0:1783137932.703702:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc6136/0x4691dfc3d66b7f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922932 expref: 8 pid: 6616 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.703724:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6616:1869755322551936:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137932.703748:0:6616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703759:0:6616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703766:0:6616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703798:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703805:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703831:0:6616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703838:0:6616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783137932.703841:0:6616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703850:0:6616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703869:0:6616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.703876:0:6616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003016ee12/0x4691dfc3d66b7f55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.704405:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2350:x1869755299495936:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 6594us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137932.704415:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:2.0:1783137932.710077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137932.710594:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299496320 00000100:00100000:3.0:1783137932.710611:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299496320 00000100:00100000:3.0:1783137932.710665:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 230 00000100:00100000:3.0:1783137932.710675:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+20:11605:x1869755299496320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783137932.710751:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.710782:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.710794:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.711057:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.711068:0:11954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.711076:0:11954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.711120:0:11954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.711132:0:11954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 21 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.711146:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322552064:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783137932.711220:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc14ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137932.715622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137932.715786:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299496448 00000100:00100000:2.0:1783137932.715794:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299496448 00010000:00010000:2.0:1783137932.715834:0:6630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 22 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.715889:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:2.0:1783137932.715899:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+22:2353:x1869755299496448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137932.715913:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137932.715919:0:6630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 22 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.715949:0:6630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 22 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.715973:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:2.0:1783137932.715979:0:6630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.715999:0:6630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.716006:0:6630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.716025:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137932.716073:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+22:2353:x1869755299496448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 175us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.716093:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84 00010000:00010000:3.0:1783137932.716390:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044200/0x4691dfc3d66b7f24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392291d expref: 21 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.716411:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322552064:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783137932.716431:0:11954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.716446:0:11954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.716452:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137932.716668:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1783137932.716808:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1783137932.716850:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1783137932.717176:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11954:1869755322552192:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783137932.717222:0:11954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137932.717311:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137932.718048:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322552192 00000100:00100000:2.0:1783137932.718055:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322552192 00000100:00100000:2.0:1783137932.718103:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137932.718112:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11954:x1869755322552192:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783137932.718188:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11954:x1869755322552192:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.718194:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137932.718382:0:11954:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1783137932.718387:0:11954:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5df5f7d880, transno 4294967322 00000100:00100000:3.0:1783137932.718404:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11954:1869755322552192:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1783137932.720526:0:11954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1783137932.721150:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11954:1869755322552320:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783137932.721234:0:11954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137932.721388:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb187600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137932.721440:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322552320 00000100:00100000:0.0:1783137932.721447:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322552320 00000100:00100000:0.0:1783137932.721532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137932.721568:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11954:x1869755322552320:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783137932.721961:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11954:x1869755322552320:12345-0@lo:1000:mdt00_004.0 Request processed in 419us (725us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783137932.721969:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137932.722488:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01433480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11954:1869755322552320:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783137932.722526:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722576:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722586:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722592:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.722596:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722627:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722643:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc39a2600) 00010000:00010000:3.0:1783137932.722646:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137932.722652:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722659:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7800/0x4691dfc3d66b7f63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722689:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722695:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722700:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722704:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783137932.722707:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722712:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722719:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137932.722721:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137932.722727:0:11954:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 24 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722748:0:11954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 24 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722757:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 24 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137932.722790:0:11954:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 24 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137932.722802:0:11954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322552448:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783137932.722866:0:11954:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137932.728043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.728227:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299496576 00000100:00100000:1.0:1783137932.728236:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299496576 00000100:00100000:1.0:1783137932.728299:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:1.0:1783137932.728309:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+25:11604:x1869755299496576:12345-192.168.202.24@tcp:49:lfs.0 00000100:00100000:1.0:1783137932.728444:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+25:11604:x1869755299496576:12345-192.168.202.24@tcp:49:lfs.0 Request processed in 136us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137932.728453:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1783137932.728900:0:11954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11954:1869755322552448:192.168.202.24@tcp:105: 00010000:00010000:2.0:1783137932.728926:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.728936:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b7ea6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.728966:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.728980:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729003:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729013:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729020:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729026:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729032:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137932.729036:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729043:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729071:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137932.729074:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137932.729078:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729094:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b7f6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729106:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729112:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729118:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729124:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137932.729126:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729132:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729139:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137932.729141:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137932.729144:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.729151:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b7f5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137932.729505:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299496320:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 18830us (19436us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1783137932.729512:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 230 00000020:00080000:2.0:1783137932.729516:0:11954:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783137932.731155:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137932.731162:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137932.732646:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783137932.732661:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137932.735200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.735394:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299496832 00000100:00100000:1.0:1783137932.735403:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299496832 00000100:00100000:1.0:1783137932.735462:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 231 00000100:00100000:1.0:1783137932.735489:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:11604:x1869755299496832:12345-192.168.202.24@tcp:58:lfs.0 00000040:00080000:1.0:1783137932.736213:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783137932.736416:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:11604:x1869755299496832:12345-192.168.202.24@tcp:58:lfs.0 Request processed in 928us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137932.736426:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 231 00000100:00100000:2.0:1783137932.745535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.750586:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497088 00000100:00100000:1.0:1783137932.750601:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497088 00000100:00100000:1.0:1783137932.750675:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:1.0:1783137932.750685:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6706050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+24:11605:x1869755299497088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783137932.752391:0:5815:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783137932.752500:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1783137932.752797:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752813:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752824:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752833:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752839:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752845:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.752956:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783137932.753141:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6706050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+26:11605:x1869755299497088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 2395us (7553us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783137932.753151:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000020:00080000:1.0:1783137932.753165:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137932.759388:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137932.759403:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.759416:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783137932.759421:0:7510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.759431:0:7510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.759450:0:7510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e5dc5113200) 00010000:00010000:2.0:1783137932.759453:0:7510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137932.759457:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.759463:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6cc00/0x4691dfc3d66b7f71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.759579:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137932.759582:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137932.759583:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137932.796342:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137932.820498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.820892:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497216 00000100:00100000:0.0:1783137932.820903:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497216 00000100:00100000:0.0:1783137932.820964:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 232 00000100:00100000:0.0:1783137932.820975:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+26:11607:x1869755299497216:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783137932.821008:0:7189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137932.821039:0:7189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922939 expref: -99 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821120:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821135:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821146:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821176:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821183:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137932.821190:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.823352:0:7189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.823373:0:7189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.823441:0:7189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.823480:0:7189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.823497:0:7189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 27 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137932.823512:0:7189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322552576:192.168.202.24@tcp:104: 00000100:00100000:1.0:1783137932.823907:0:7189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd1394240 going to sleep for 11 seconds 00000100:00100000:3.0:1783137932.832437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137932.832594:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497472 00000100:00100000:0.0:1783137932.832694:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497472 00000100:00100000:0.0:1783137932.832755:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:0.0:1783137932.832764:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+28:5580:x1869755299497472:12345-192.168.202.24@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783137932.832998:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+29:5580:x1869755299497472:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 234us (572us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1783137932.833006:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:1.0:1783137932.833304:0:7189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7189:1869755322552576:192.168.202.24@tcp:104: 00010000:00010000:1.0:1783137932.833331:0:7189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137932.838878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137932.839052:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497600 00000100:00100000:1.0:1783137932.839063:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497600 00010000:00010000:1.0:1783137932.839115:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 29 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137932.839179:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:1.0:1783137932.839189:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:2352:x1869755299497600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137932.839206:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137932.839213:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 29 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839226:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 29 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839510:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7e98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239228fa expref: 29 pid: 5813 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839529:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137932.839535:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839805:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839815:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137932.839848:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137932.839919:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75742c0b-74ec-412f-af86-0dbffc92280b+28:2352:x1869755299497600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 730us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137932.839927:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00010000:00010000:2.0:1783137932.839999:0:7189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840006:0:7189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137932.840064:0:7189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783137932.840069:0:7189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137932.840098:0:7189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840109:0:7189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840117:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840123:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840128:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840134:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137932.840138:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840145:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840154:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:2.0:1783137932.840156:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137932.840160:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840166:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045400/0x4691dfc3d66b7f7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840190:0:7189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840197:0:7189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840202:0:7189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840207:0:7189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137932.840210:0:7189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840217:0:7189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840225:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e5dcc9ec900) 00010000:00010000:2.0:1783137932.840227:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137932.840230:0:7189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840236:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7f86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840284:0:7189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7f78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922939 expref: 28 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840299:0:7189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922939 expref: 27 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137932.840316:0:7189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137932.840318:0:7189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137932.840320:0:7189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c400, rc 0) 00000100:00100000:2.0:1783137932.840350:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:11607:x1869755299497216:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 19378us (19864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137932.840357:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 232 00000001:00080000:2.0:1783137933.105515:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1783137933.105569:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1783137933.409948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137933.410013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137933.410048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137933.410096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137933.410120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137933.410149:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299498240 00000100:00100000:3.0:1783137933.410158:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299498240 00000100:00100000:0.0:1783137933.410345:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497984 00000100:00100000:0.0:1783137933.410350:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497984 00000100:00100000:0.0:1783137933.410398:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299498112 00000100:00100000:0.0:1783137933.410401:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299498112 00000100:00100000:0.0:1783137933.410425:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1783137933.410434:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299497984:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137933.410504:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299497984:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 71us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137933.410513:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107 00000100:00100000:0.0:1783137933.410531:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:0.0:1783137933.410583:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299498112:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137933.410627:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299498112:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 46us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137933.410633:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108 00000100:00100000:3.0:1783137933.411176:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497856 00000100:00100000:3.0:1783137933.411181:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497856 00000100:00100000:2.0:1783137933.411287:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299497728 00000100:00100000:2.0:1783137933.411292:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299497728 00000100:00100000:2.0:1783137933.411323:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 306 00000100:00100000:2.0:1783137933.411329:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299497728:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137933.411366:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299497728:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 36us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137933.411372:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 306 00000100:00100000:3.0:1783137933.411745:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:3.0:1783137933.411753:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299498240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137933.411798:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299498240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 46us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137933.411805:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178 00000100:00100000:3.0:1783137933.411817:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00100000:3.0:1783137933.411823:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:2351:x1869755299497856:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137933.411848:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+27:2351:x1869755299497856:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137933.411854:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179 00000100:00080000:3.0:1783137933.411873:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137933.411877:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1783137933.754869:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137933.754886:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137933.754935:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783137933.754943:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137933.755095:0:11564:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322552704:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137933.755190:0:11564:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd13949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137933.773164:0:11564:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1869755322552704:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137933.779707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137933.779949:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299498368 00000100:00100000:1.0:1783137933.779960:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299498368 00000100:00100000:1.0:1783137933.780030:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 233 00000100:00100000:1.0:1783137933.780041:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:11619:x1869755299498368:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783137933.780073:0:7189:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783137933.780176:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+27:11619:x1869755299498368:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 138us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137933.780185:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 233 00000100:00100000:3.0:1783137933.786906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137933.787099:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299498624 00000100:00100000:1.0:1783137933.787109:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299498624 00000100:00100000:1.0:1783137933.787172:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:1.0:1783137933.787183:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+27:11619:x1869755299498624:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137933.787204:0:11954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137933.787224:0:11954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7f94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922940 expref: -99 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137933.787323:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137933.787337:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137933.787349:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137933.787376:0:11954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783137933.787506:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6d800/0x4691dfc3d66b7f94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922940 expref: 30 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137933.787525:0:11954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922940 expref: 29 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137933.787534:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137933.787562:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137933.787566:0:11954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c800, rc 0) 00000100:00100000:1.0:1783137933.787632:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+29:11619:x1869755299498624:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 451us (736us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1783137933.787640:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 234 00000100:00100000:1.0:1783137933.806411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137933.806457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137933.806582:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299498880 00000100:00100000:0.0:1783137933.806592:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299498880 00000100:00100000:0.0:1783137933.806661:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 235 00000100:00100000:0.0:1783137933.806671:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:11619:x1869755299498880:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783137933.806746:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806764:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806775:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806959:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806967:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806987:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.806993:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783137933.806997:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.807273:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.807287:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:0.0:1783137933.807290:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137933.807296:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137933.807303:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045200/0x4691dfc3d66b7fa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137933.807465:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75742c0b-74ec-412f-af86-0dbffc92280b+30:11619:x1869755299498880:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 794us (1064us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783137933.807474:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 235 00000100:00100000:2.0:1783137933.808411:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499008 00000100:00100000:2.0:1783137933.808419:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499008 00000100:00100000:2.0:1783137933.808474:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1783137933.808482:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+30:2350:x1869755299499008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137933.808495:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137933.808512:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c800/0x4691dfc3d66b7f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922940 expref: 30 pid: 11954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137933.808526:0:6630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137933.808529:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137933.808776:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75742c0b-74ec-412f-af86-0dbffc92280b+29:2350:x1869755299499008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 293us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137933.808784:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000040:00080000:3.0:1783137933.808920:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137933.808925:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783137933.813309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137933.813378:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499264 00000100:00100000:2.0:1783137933.813387:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499264 00000100:00100000:2.0:1783137933.813444:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:2.0:1783137933.813455:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+29:11619:x1869755299499264:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1783137933.813694:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783137933.813707:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137933.813720:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+30:11619:x1869755299499264:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 265us (418us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1783137933.813729:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00010000:00010000:3.0:1783137933.819233:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137934.010751:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137934.010777:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322552832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137934.010846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137934.010913:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322552832 00000100:00100000:3.0:1783137934.010920:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322552832 00000100:00100000:3.0:1783137934.010985:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783137934.010995:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322552832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137934.011030:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137934.011096:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322552832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137934.011104:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1783137934.011126:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137934.011152:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783137934.011157:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1783137934.011174:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e5df594d880, transno 4294967310 00000100:00100000:3.0:1783137934.011190:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322552832:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783137934.099904:0:12453:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137934.099913:0:12453:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137934.099981:0:12453:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783137934.099989:0:12453:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137934.561004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137934.562497:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499520 00000100:00100000:3.0:1783137934.562510:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499520 00000100:00100000:3.0:1783137934.562631:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:3.0:1783137934.562643:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+30:11632:x1869755299499520:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783137934.562691:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137934.562721:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7fb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922947 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.562840:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7fb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.562855:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.562875:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137934.562892:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783137934.563063:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b7fb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922947 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.563116:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7fb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922947 expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.563125:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:3.0:1783137934.563128:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783137934.563131:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6600, rc 0) 00000100:00100000:3.0:1783137934.563189:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+32:11632:x1869755299499520:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 549us (2205us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783137934.563197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 236 00000100:00100000:1.0:1783137934.575109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137934.575210:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499648 00000100:00100000:2.0:1783137934.575221:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499648 00000100:00100000:2.0:1783137934.575283:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:2.0:1783137934.575293:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+32:11632:x1869755299499648:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1783137934.575358:0:11954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575375:0:11954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575386:0:11954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575413:0:11954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575420:0:11954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575444:0:11954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575451:0:11954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3d400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783137934.575455:0:11954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575463:0:11954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575475:0:11954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:2.0:1783137934.575478:0:11954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137934.575483:0:11954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137934.575489:0:11954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d400/0x4691dfc3d66b7fc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137934.575626:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75742c0b-74ec-412f-af86-0dbffc92280b+32:11632:x1869755299499648:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 334us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137934.575634:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 237 00000100:00100000:0.0:1783137934.840997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137934.841987:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499776 00000100:00100000:3.0:1783137934.841999:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499776 00000100:00100000:3.0:1783137934.842096:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00100000:3.0:1783137934.842109:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2352:x1869755299499776:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:3.0:1783137934.842128:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137934.842149:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7fcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392294e expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137934.842175:0:6615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a48868a, atime: 0x6a48868a, ctime: 0x6a48868a, blocks: 0xb 00010000:00010000:3.0:1783137934.842194:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1783137934.842199:0:6615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137934.842208:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7fcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392294e expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.842227:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7fcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392294e expref: 8 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137934.842260:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783137934.842330:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+8:2352:x1869755299499776:12345-192.168.202.24@tcp:101:cat.0 Request processed in 224us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137934.842337:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71 00000100:00080000:0.0:1783137934.844225:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783137934.847181:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137934.852510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137934.852678:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299499904 00000100:00100000:2.0:1783137934.852688:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299499904 00002000:00100000:2.0:1783137934.852751:0:6621:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e5df5abf100 x1869755299499904/t0(0) o3->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:85/0 lens 488/0 e 0 to 0 dl 1783137945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137934.852763:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5abf100 with x1869755299499904 ext(0->4095) 00002000:00010000:2.0:1783137934.852770:0:6621:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df5abf100 00000100:00100000:2.0:1783137934.852810:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1783137934.852822:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2351:x1869755299499904:12345-192.168.202.24@tcp:3:cat.0 00000100:00100000:2.0:1783137934.853103:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75742c0b-74ec-412f-af86-0dbffc92280b+8:2351:x1869755299499904:12345-192.168.202.24@tcp:3:cat.0 Request processed in 283us (601us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783137934.853111:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00002000:00100000:2.0:1783137934.853119:0:6621:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e5df5abf100 x1869755299499904/t0(0) o3->75742c0b-74ec-412f-af86-0dbffc92280b@192.168.202.24@tcp:85/0 lens 488/4536 e 0 to 0 dl 1783137945 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137934.853128:0:6621:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5df5abf100 with x1869755299499904 ext(0->4095) 00002000:00010000:2.0:1783137934.853131:0:6621:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e5df5abf100 00010000:00010000:2.0:1783137935.867154:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137936.058945:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553344:0@lo:400:kworker.0 00000100:00100000:1.0:1783137936.058952:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322553216:0@lo:400:kworker.0 00000100:00100000:2.0:1783137936.059014:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322552960:0@lo:400:kworker.0 00000100:00100000:0.0:1783137936.059071:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322553088:0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.065156:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137936.065249:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553344 00000100:00100000:3.0:1783137936.065258:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553344 00000100:00100000:3.0:1783137936.065318:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783137936.065455:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322553344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.065512:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322553344:12345-0@lo:400:kworker.0 Request processed in 60us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137936.066013:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137936.066055:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322553472:0@lo:400:kworker.0 00000100:00100000:2.0:1783137936.066088:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137936.066126:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553472 00000100:00100000:2.0:1783137936.066131:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553472 00000100:00100000:2.0:1783137936.066164:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783137936.066172:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322553472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137936.066213:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322553472:12345-0@lo:400:kworker.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137936.066220:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783137936.066258:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322553472:0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.066262:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1783137936.066280:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137936.066283:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137936.066307:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553344:0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.066311:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322552960 00000100:00100000:3.0:1783137936.066314:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322552960 00000100:00100000:3.0:1783137936.066354:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783137936.066360:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322552960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137936.066708:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137936.066731:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322553600:0@lo:400:kworker.0 00000100:00100000:0.0:1783137936.066757:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137936.068831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553088 00000100:00100000:2.0:1783137936.068844:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553088 00000100:00100000:2.0:1783137936.068916:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783137936.068943:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322553088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137936.069035:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df594c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322553088:12345-0@lo:400:kworker.0 Request processed in 94us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137936.069042:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783137936.070535:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322552960:12345-0@lo:400:kworker.0 Request processed in 4168us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137936.070561:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783137936.071174:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553600 00000100:00100000:3.0:1783137936.071182:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553600 00000100:00100000:0.0:1783137936.071234:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322553088:0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.071240:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783137936.071258:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322553600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137936.071318:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322553600:12345-0@lo:400:kworker.0 Request processed in 61us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137936.071338:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783137936.071341:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322553600:0@lo:400:kworker.0 00000100:00080000:3.0:1783137936.071355:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137936.076807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137936.077140:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553216 00000100:00100000:0.0:1783137936.077150:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553216 00000100:00100000:0.0:1783137936.077232:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783137936.077243:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322553216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137936.077301:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322553216:12345-0@lo:400:kworker.0 Request processed in 60us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137936.077308:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1783137936.079735:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137936.080099:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322553216:0@lo:400:kworker.0 00000100:00100000:2.0:1783137936.080234:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322552960:0@lo:400:kworker.0 00000100:00100000:0.0:1783137936.574412:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137936.574437:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137936.574507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137936.574640:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553728 00000100:00100000:2.0:1783137936.574648:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553728 00000100:00100000:2.0:1783137936.574703:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783137936.574713:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322553728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137936.574749:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137936.574795:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322553728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137936.574801:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137936.574961:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137936.893391:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137937.688343:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1783137937.688370:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1783137937.688382:0:5833:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e5cc2412900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1783137937.688387:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd811a700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e5cc2412d80 00000020:00080000:3.0:1783137937.688391:0:5833:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e5dd811ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e5cc2903800 00000001:00080000:3.0:1783137937.688410:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1783137937.688507:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783137937.689028:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1783137937.916364:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137938.151427:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1783137938.151443:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1783137938.533761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137938.533806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137938.533856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137938.533885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137938.533927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137938.534000:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500032 00000100:00100000:3.0:1783137938.534013:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500032 00000100:00100000:3.0:1783137938.534084:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 308 00000100:00100000:3.0:1783137938.534096:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299500032:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137938.534195:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299500032:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137938.534203:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 308 00000100:00100000:3.0:1783137938.534255:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500416 00000100:00100000:3.0:1783137938.534259:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500416 00000100:00100000:3.0:1783137938.534300:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500288 00000100:00100000:3.0:1783137938.534303:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500288 00000100:00100000:3.0:1783137938.534328:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:3.0:1783137938.534336:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299500416:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137938.534370:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299500416:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137938.534377:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:3.0:1783137938.534389:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:3.0:1783137938.534396:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299500288:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137938.534421:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299500288:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137938.534428:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:3.0:1783137938.534448:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500160 00000100:00100000:3.0:1783137938.534451:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500160 00000100:00100000:3.0:1783137938.534479:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500544 00000100:00100000:3.0:1783137938.534481:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500544 00000100:00100000:3.0:1783137938.534501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:3.0:1783137938.534507:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299500160:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137938.534540:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299500160:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137938.534573:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 183 00000100:00100000:3.0:1783137938.534585:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00100000:3.0:1783137938.534592:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299500544:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783137938.534622:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2351:x1869755299500544:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 31us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137938.534635:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 184 00000100:00080000:3.0:1783137938.534768:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137938.534774:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137938.534777:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783137938.948866:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137939.136166:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc1339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137939.136238:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137939.136300:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553856 00000100:00100000:3.0:1783137939.136306:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553856 00000100:00100000:3.0:1783137939.136351:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783137939.136366:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322553856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137939.136401:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137939.136437:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322553856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137939.136444:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1783137939.136461:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137939.136502:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc1339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322553856:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783137939.963168:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137939.963182:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137939.963597:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1783137939.963612:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783137939.963618:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137940.986722:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137941.178901:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322553984:0@lo:400:kworker.0 00000100:00100000:2.0:1783137941.178901:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322554240:0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.179003:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322554112:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.179394:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137941.179463:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322554496:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.179506:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137941.179686:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322553984 00000100:00100000:0.0:1783137941.179697:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322553984 00000100:00100000:0.0:1783137941.179761:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783137941.179772:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322553984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137941.179839:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322553984:12345-0@lo:400:kworker.0 Request processed in 69us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137941.179848:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783137941.180043:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137941.180071:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322554624:0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.180099:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137941.180138:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554496 00000100:00100000:1.0:1783137941.180141:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554496 00000100:00100000:1.0:1783137941.180185:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554112 00000100:00100000:1.0:1783137941.180188:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554112 00000100:00100000:1.0:1783137941.180209:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783137941.180216:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322554496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.180253:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322554496:12345-0@lo:400:kworker.0 Request processed in 38us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137941.180260:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783137941.180273:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783137941.180279:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322554112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.180310:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322554112:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137941.180316:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783137941.180337:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554624 00000100:00100000:1.0:1783137941.180340:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554624 00000100:00100000:1.0:1783137941.180367:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783137941.180372:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322554624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.180399:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322554624:12345-0@lo:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137941.180405:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1783137941.180420:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137941.180442:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137941.180497:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322554112:0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.180508:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1783137941.180514:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1783137941.180536:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322554624:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.180884:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322553984:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.180896:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322554496:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.184640:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554368:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.184761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137941.184789:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137941.184901:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554368 00000100:00100000:1.0:1783137941.184923:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554368 00000100:00100000:1.0:1783137941.185038:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783137941.185050:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137941.185124:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554368:12345-0@lo:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137941.185132:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783137941.185345:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554368:0@lo:400:kworker.0 00000100:00080000:2.0:1783137941.185837:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137941.190758:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554240 00000100:00100000:0.0:1783137941.190783:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554240 00000100:00100000:0.0:1783137941.190928:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783137941.190942:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322554240:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783137941.190990:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137941.191085:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322554240:12345-0@lo:400:kworker.0 Request processed in 145us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137941.191094:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1783137941.191184:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322554240:0@lo:400:kworker.0 00000100:00100000:3.0:1783137941.273661:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137941.273863:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500672 00000100:00100000:1.0:1783137941.273877:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500672 00000100:00100000:1.0:1783137941.273980:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00100000:1.0:1783137941.273993:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11284:x1869755299500672:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783137941.274153:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11284:x1869755299500672:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 162us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137941.274161:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 238 00000100:00080000:2.0:1783137941.274957:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137941.283766:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137941.283865:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299500928 00000100:00100000:0.0:1783137941.283877:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299500928 00000100:00100000:0.0:1783137941.283956:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1783137941.283969:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+19:11284:x1869755299500928:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137941.284729:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:11284:x1869755299500928:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 758us (974us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783137941.284739:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1783137941.691442:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137941.697187:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137941.697314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137941.702236:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554752 00000100:00100000:3.0:1783137941.702258:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554752 00000100:00100000:3.0:1783137941.702449:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783137941.702462:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137941.702518:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137941.702992:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 530us (5676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137941.703002:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783137941.706129:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137941.802997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137941.803213:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501056 00000100:00100000:0.0:1783137941.803225:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501056 00000100:00100000:0.0:1783137941.803325:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00100000:0.0:1783137941.803337:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+5:12083:x1869755299501056:12345-192.168.202.24@tcp:101:lsof.0 00010000:00010000:0.0:1783137941.803365:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137941.803393:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922955 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.803473:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.803488:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.803515:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137941.803987:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137941.803992:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137941.804118:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.804143:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044400/0x4691dfc3d66b7fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922955 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.804162:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922955 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137941.804169:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:0.0:1783137941.804172:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137941.804174:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044000, rc 0) 00000100:00100000:0.0:1783137941.804247:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59eaef08-1a40-49b6-b925-58fee4e19e35+6:12083:x1869755299501056:12345-192.168.202.24@tcp:101:lsof.0 Request processed in 912us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137941.804252:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 239 00000100:00080000:2.0:1783137941.805179:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137942.011057:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137942.785210:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1783137942.785241:0:5833:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1783137942.785436:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783137942.785451:0:5844:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1783137943.039174:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137943.649117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137943.649250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137943.649296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137943.649337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137943.649378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137943.649614:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501696 00000100:00100000:0.0:1783137943.649629:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501696 00000100:00100000:0.0:1783137943.649725:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501312 00000100:00100000:0.0:1783137943.649728:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501312 00000100:00100000:0.0:1783137943.649756:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:0.0:1783137943.649769:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2351:x1869755299501696:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137943.649920:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2351:x1869755299501696:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 151us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137943.649928:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 188 00000100:00100000:0.0:1783137943.649951:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00100000:0.0:1783137943.649957:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299501312:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137943.649987:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299501312:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137943.649993:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189 00000100:00080000:3.0:1783137943.650427:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137943.650727:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501440 00000100:00100000:1.0:1783137943.650734:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501440 00000100:00100000:1.0:1783137943.650796:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501568 00000100:00100000:1.0:1783137943.650800:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501568 00000100:00100000:1.0:1783137943.650832:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:1.0:1783137943.650842:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299501440:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137943.650933:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299501440:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 92us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137943.650941:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:1.0:1783137943.650958:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:1.0:1783137943.650965:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299501568:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783137943.650992:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299501568:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137943.650998:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00080000:3.0:1783137943.652667:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137943.652691:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137943.653617:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501184 00000100:00100000:2.0:1783137943.653636:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501184 00000100:00100000:2.0:1783137943.653754:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 310 00000100:00100000:2.0:1783137943.653767:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299501184:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783137943.654278:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299501184:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 510us (5177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137943.654290:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 310 00010000:00010000:0.0:1783137944.060294:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137944.255495:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc1338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137944.255629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137944.256826:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322554880 00000100:00100000:3.0:1783137944.256843:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322554880 00000100:00100000:3.0:1783137944.256942:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783137944.256954:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137944.257009:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137944.257099:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322554880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137944.257127:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783137944.257205:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137944.257302:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc1338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322554880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137945.083070:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137946.108048:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137946.257892:0:12654:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:05:43 (1783137943) 00000100:00100000:0.0:1783137946.303468:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322555136:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303541:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303621:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322555648:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303649:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303678:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137946.303684:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322555008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303713:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303743:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322555520:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303766:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303793:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322555264:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303816:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303832:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137946.303838:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322555392:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.303859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137946.303914:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555136 00000100:00100000:0.0:1783137946.303922:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555136 00000100:00100000:0.0:1783137946.304070:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555520 00000100:00100000:0.0:1783137946.304075:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555520 00000100:00100000:0.0:1783137946.304416:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555264 00000100:00100000:0.0:1783137946.304421:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555264 00000100:00100000:0.0:1783137946.304446:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783137946.304454:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322555136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.304516:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322555136:12345-0@lo:400:kworker.0 Request processed in 62us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137946.304523:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783137946.304539:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783137946.304569:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322555520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.304600:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869755322555520:12345-0@lo:400:kworker.0 Request processed in 56us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137946.304606:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783137946.304618:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783137946.304624:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322555264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.304655:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322555264:12345-0@lo:400:kworker.0 Request processed in 31us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137946.304661:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783137946.304681:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555648 00000100:00100000:0.0:1783137946.304684:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555648 00000100:00100000:0.0:1783137946.304715:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555392 00000100:00100000:0.0:1783137946.304719:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555392 00000100:00100000:0.0:1783137946.304741:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783137946.304748:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322555648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.304779:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322555648:12345-0@lo:400:kworker.0 Request processed in 32us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137946.304794:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783137946.304805:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783137946.304811:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322555392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.304839:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322555392:12345-0@lo:400:kworker.0 Request processed in 28us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137946.304844:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783137946.306514:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555008 00000100:00100000:3.0:1783137946.306529:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555008 00000100:00100000:3.0:1783137946.306608:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783137946.306618:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322555008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137946.306691:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322555008:12345-0@lo:400:kworker.0 Request processed in 74us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137946.306699:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1783137946.310123:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137946.310139:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137946.310144:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137946.310218:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322555008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.310244:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869755322555520:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.310258:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322555136:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.310269:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322555648:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.310329:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322555392:0@lo:400:kworker.0 00000100:00100000:0.0:1783137946.310341:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322555264:0@lo:400:kworker.0 00000100:00100000:1.0:1783137946.814600:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137946.814642:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322555776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137946.814760:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137946.816141:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555776 00000100:00100000:3.0:1783137946.816156:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555776 00000100:00100000:3.0:1783137946.816248:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783137946.816261:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322555776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137946.816501:0:6619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137946.816676:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322555776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 416us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137946.816684:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783137946.816860:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322555776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137947.135650:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137948.156368:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137948.772349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137948.772396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137948.772434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137948.772460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137948.772484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137948.772520:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501824 00000100:00100000:0.0:1783137948.772533:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501824 00000100:00100000:0.0:1783137948.772628:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 312 00000100:00100000:0.0:1783137948.772640:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299501824:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137948.772748:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299501824:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137948.772757:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 312 00000100:00100000:0.0:1783137948.772800:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299502208 00000100:00100000:0.0:1783137948.772803:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299502208 00000100:00100000:0.0:1783137948.772842:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299502080 00000100:00100000:0.0:1783137948.772845:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299502080 00000100:00100000:0.0:1783137948.772879:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:0.0:1783137948.772885:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299502208:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137948.772919:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2351:x1869755299502208:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137948.772925:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:0.0:1783137948.772937:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:0.0:1783137948.772942:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299502080:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137948.773199:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+5:2351:x1869755299502080:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 255us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137948.773207:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:0.0:1783137948.773231:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299501952 00000100:00100000:0.0:1783137948.773234:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299501952 00000100:00100000:0.0:1783137948.773265:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299502336 00000100:00100000:0.0:1783137948.773268:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299502336 00000100:00100000:0.0:1783137948.773288:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:0.0:1783137948.773294:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299501952:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137948.773324:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75742c0b-74ec-412f-af86-0dbffc92280b+19:2351:x1869755299501952:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137948.773341:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193 00000100:00100000:0.0:1783137948.773355:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00100000:0.0:1783137948.773361:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2351:x1869755299502336:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783137948.773390:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2351:x1869755299502336:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137948.773397:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 194 00000100:00080000:0.0:1783137948.774173:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137948.774183:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137948.774186:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1783137949.179075:0:11564:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137949.179088:0:11564:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137949.179846:0:11564:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1783137949.179868:0:11564:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783137949.180291:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137949.371306:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc1339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322555904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137949.371410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137949.371609:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322555904 00000100:00100000:3.0:1783137949.371622:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322555904 00000100:00100000:3.0:1783137949.371705:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783137949.371717:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322555904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137949.371765:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137949.371817:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322555904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137949.371825:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783137949.372691:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137949.372755:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc1339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322555904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137950.202893:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137951.185291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137951.185398:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299502592 00000100:00100000:2.0:1783137951.185416:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299502592 00000100:00100000:2.0:1783137951.185626:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:2.0:1783137951.185644:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+19:12305:x1869755299502592:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:2.0:1783137951.188630:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+20:12305:x1869755299502592:12345-192.168.202.24@tcp:35:umount.0 Request processed in 2974us (3329us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783137951.188647:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00080000:1.0:1783137951.192681:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137951.193033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137951.193141:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299502848 00000100:00100000:3.0:1783137951.193154:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299502848 00000100:00100000:3.0:1783137951.193226:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:3.0:1783137951.193245:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+20:12305:x1869755299502848:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:3.0:1783137951.193773:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:12305:x1869755299502848:12345-192.168.202.24@tcp:35:umount.0 Request processed in 535us (748us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783137951.193782:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:0.0:1783137951.202639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137951.207592:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299503104 00000100:00100000:3.0:1783137951.207614:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299503104 00000100:00100000:3.0:1783137951.211068:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:3.0:1783137951.211099:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc6705850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+21:12305:x1869755299503104:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:3.0:1783137951.211592:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc6705850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:12305:x1869755299503104:12345-192.168.202.24@tcp:35:umount.0 Request processed in 506us (8966us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783137951.211605:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:1.0:1783137951.218883:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137951.219152:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299503360 00000100:00100000:2.0:1783137951.219163:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299503360 00000100:00100000:2.0:1783137951.219225:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1783137951.219235:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+22:12305:x1869755299503360:12345-192.168.202.24@tcp:35:umount.0 00000100:00100000:2.0:1783137951.219590:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75742c0b-74ec-412f-af86-0dbffc92280b+23:12305:x1869755299503360:12345-192.168.202.24@tcp:35:umount.0 Request processed in 355us (716us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783137951.219615:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00010000:00010000:2.0:1783137951.227687:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137951.228568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137951.228604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783137951.228632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137951.228678:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299503488 00000100:00100000:3.0:1783137951.228706:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299503488 00000100:00100000:1.0:1783137951.228707:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299503744 00000100:00100000:1.0:1783137951.228719:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299503744 00000100:00100000:3.0:1783137951.228794:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299503616 00000100:00100000:3.0:1783137951.228799:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299503616 00000100:00100000:1.0:1783137951.235308:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1783137951.235347:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+15:2351:x1869755299503488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137951.235370:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137951.235398:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684800/0x4691dfc3d66b7036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e0 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.235417:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137951.235479:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+14:2351:x1869755299503488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 143us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137951.235487:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1783137951.235537:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1783137951.235568:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+13:2351:x1869755299503744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137951.235577:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137951.235586:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684000/0x4691dfc3d66b7266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225ab expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.235595:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137951.235609:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+12:2351:x1869755299503744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (7004us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137951.235614:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1783137951.235626:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1783137951.235632:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2351:x1869755299503616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137951.235639:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137951.235647:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b6fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224a8 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.235654:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137951.235673:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2351:x1869755299503616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 41us (7040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137951.235679:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1783137951.238203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137951.238809:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299504128 00000100:00100000:3.0:1783137951.238901:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299504128 00000100:00100000:3.0:1783137951.238995:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00100000:3.0:1783137951.239010:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+7:2349:x1869755299504128:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:3.0:1783137951.239056:0:6615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b758b 00000020:00010000:3.0:1783137951.239067:0:6615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e5dffbc8800: total 0 00000100:00080000:3.0:1783137951.239072:0:6615:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137951.239148:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1783137951.239444:0:5800:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e5dffbc8800: total 0 00010000:00010000:1.0:1783137951.239539:0:5800:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e5dffbc8800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783137951.239669:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065e23eec/0x4691dfc3d66b792e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922780 expref: 5 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.239712:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b7fcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392294e expref: 4 pid: 6615 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.239727:0:5800:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e5dffbc8800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783137951.239738:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137951.239739:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137951.239741:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137951.240335:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75742c0b-74ec-412f-af86-0dbffc92280b+2:2349:x1869755299504128:12345-192.168.202.24@tcp:9:umount.0 Request processed in 1319us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.240349:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72 00000100:00080000:3.0:1783137951.240400:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137951.262542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137951.262679:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299504256 00000100:00100000:0.0:1783137951.262696:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299504256 00000100:00100000:0.0:1783137951.262812:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:0.0:1783137951.262826:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+5:2349:x1869755299504256:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:0.0:1783137951.262874:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b732a 00000100:00080000:0.0:1783137951.262886:0:6617:0:(import.c:65:import_set_state_nolock()) ffff8e5dc57b7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137951.262939:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1783137951.263141:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137951.263464:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137951.264166:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75742c0b-74ec-412f-af86-0dbffc92280b+2:2349:x1869755299504256:12345-192.168.202.24@tcp:9:umount.0 Request processed in 1338us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137951.264177:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73 00000100:00100000:3.0:1783137951.277528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137951.277660:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299505280 00000100:00100000:0.0:1783137951.277676:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299505280 00000100:00100000:0.0:1783137951.277774:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 240 00000100:00100000:0.0:1783137951.277786:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+23:2349:x1869755299505280:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:0.0:1783137951.277823:0:5811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6fc6 00000020:00010000:0.0:1783137951.277874:0:5811:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e5df5962000: total 0 00000100:00080000:0.0:1783137951.277878:0:5811:0:(import.c:65:import_set_state_nolock()) ffff8e5dc6022000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137951.277970:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1783137951.278875:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75742c0b-74ec-412f-af86-0dbffc92280b+22:2349:x1869755299505280:12345-192.168.202.24@tcp:39:umount.0 Request processed in 1088us (1361us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783137951.278886:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 240 00000020:00010000:1.0:1783137951.280722:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e5df5962000: total 0 00010000:00010000:1.0:1783137951.280922:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e5df5962000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1783137951.280960:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137951.280965:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783137951.280977:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6600/0x4691dfc3d66b7fb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922947 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.281003:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137951.281006:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783137951.281011:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030c00/0x4691dfc3d66b7919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922779 expref: 20 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.281709:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137951.281711:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137951.281717:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b7300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225d5 expref: 19 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.281732:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137951.281735:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137951.281739:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6ca00/0x4691dfc3d66b7ead lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922901 expref: 18 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.281751:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e5dc39a2500) 00010000:00010000:1.0:1783137951.281753:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137951.281756:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030200/0x4691dfc3d66b75ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239226a7 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.282945:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5dcc9ec200) 00010000:00010000:1.0:1783137951.282953:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137951.282961:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0031600/0x4691dfc3d66b7290 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225b9 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.282983:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137951.282986:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137951.282990:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02045800/0x4691dfc3d66b79ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239227a3 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283005:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e5dcc9ec700) 00010000:00010000:1.0:1783137951.283007:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137951.283026:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b7c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922875 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283115:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137951.283118:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137951.283123:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6dc00/0x4691dfc3d66b780f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922733 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283134:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137951.283136:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137951.283140:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc0030600/0x4691dfc3d66b790b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922772 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283153:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:1.0:1783137951.283156:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137951.283160:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dc5685200/0x4691dfc3d66b72ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225c0 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283176:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e5de2d1ca00) 00010000:00010000:1.0:1783137951.283178:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783137951.283182:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b78e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392276b expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283197:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e5de2d1ce00) 00010000:00010000:1.0:1783137951.283200:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137951.283204:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dd9e6c400/0x4691dfc3d66b7f8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922939 expref: 9 pid: 7189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283217:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:1.0:1783137951.283226:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137951.283231:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ca00/0x4691dfc3d66b7990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392279c expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137951.283242:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e5df5962000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1783137951.283271:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137951.283273:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137951.283276:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137951.419054:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322556032:0@lo:400:kworker.0 00000100:00100000:2.0:1783137951.419138:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137951.419354:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556032 00000100:00100000:3.0:1783137951.419363:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556032 00000100:00100000:3.0:1783137951.419416:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783137951.419426:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322556032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.419484:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322556032:12345-0@lo:400:kworker.0 Request processed in 59us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.419492:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783137951.419538:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322556032:0@lo:400:kworker.0 00000100:00100000:0.0:1783137951.419703:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322556288:0@lo:400:kworker.0 00000100:00100000:0.0:1783137951.419738:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137951.419757:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137951.419761:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322556416:0@lo:400:kworker.0 00000100:00100000:0.0:1783137951.419785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137951.419955:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556416 00000100:00100000:3.0:1783137951.419960:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556416 00000100:00100000:3.0:1783137951.420004:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783137951.420011:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322556416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420051:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322556416:12345-0@lo:400:kworker.0 Request processed in 41us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.420055:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783137951.420083:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322556416:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420099:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322556544:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420122:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137951.420136:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783137951.420152:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322556160:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420169:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137951.420180:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322556672:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420191:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137951.420206:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556288 00000100:00100000:3.0:1783137951.420208:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556288 00000100:00100000:3.0:1783137951.420228:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556544 00000100:00100000:3.0:1783137951.420231:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556544 00000100:00100000:3.0:1783137951.420246:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556160 00000100:00100000:3.0:1783137951.420248:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556160 00000100:00100000:3.0:1783137951.420260:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783137951.420266:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322556288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420300:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322556288:12345-0@lo:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.420304:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783137951.420312:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783137951.420316:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322556544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420336:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc133a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869755322556544:12345-0@lo:400:kworker.0 Request processed in 20us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.420340:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783137951.420346:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783137951.420349:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322556160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420362:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322556160:12345-0@lo:400:kworker.0 Request processed in 13us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.420365:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783137951.420377:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556672 00000100:00100000:3.0:1783137951.420379:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556672 00000100:00100000:3.0:1783137951.420403:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783137951.420408:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc1338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322556672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420435:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc1338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322556672:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137951.420441:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783137951.420466:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322556288:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420480:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322556160:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420485:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322556672:0@lo:400:kworker.0 00000100:00100000:3.0:1783137951.420490:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869755322556544:0@lo:400:kworker.0 00000100:00080000:0.0:1783137951.420640:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137951.420643:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137951.420645:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137951.930821:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322556800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137951.930910:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137951.931181:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556800 00000100:00100000:0.0:1783137951.931189:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556800 00000100:00100000:0.0:1783137951.931242:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137951.931251:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322556800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137951.931290:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137951.931354:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322556800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137951.931361:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783137951.931471:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322556800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137952.251506:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783137953.081435:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000001:00080000:1.0:1783137953.081468:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1783137953.081492:0:5833:0:(genops.c:906:class_export_put()) final put ffff8e5df5962000/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137953.082148:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5962000/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-MDT0000 00000020:00000080:2.0:1783137953.082228:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dc6022000 for lustre-MDT0000 00010000:00010000:2.0:1783137953.275075:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137953.528806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137953.528857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137953.528884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783137953.528913:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299505408 00000100:00100000:0.0:1783137953.528924:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299505408 00000100:00100000:0.0:1783137953.528975:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299505664 00000100:00100000:1.0:1783137953.528978:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299505536 00000100:00100000:1.0:1783137953.528983:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299505536 00000100:00100000:0.0:1783137953.528986:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299505664 00000100:00100000:1.0:1783137953.529006:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1783137953.529015:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+12:2350:x1869755299505408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137953.529030:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137953.529051:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b7098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224f5 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137953.529069:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137953.529121:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2350:x1869755299505408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137953.533477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783137953.533520:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299505920 00000100:00100000:3.0:1783137953.533528:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299505920 00000100:00100000:3.0:1783137953.533718:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 241 00000100:00100000:3.0:1783137953.533727:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59eaef08-1a40-49b6-b925-58fee4e19e35+6:2349:x1869755299505920:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:3.0:1783137953.533758:0:11954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b70ad 00000020:00010000:3.0:1783137953.533764:0:11954:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e5dffbcc800: total 0 00000100:00080000:3.0:1783137953.533767:0:11954:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137953.533784:0:11954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1783137953.534692:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59eaef08-1a40-49b6-b925-58fee4e19e35+5:2349:x1869755299505920:12345-192.168.202.24@tcp:39:umount.0 Request processed in 961us (1220us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783137953.534699:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 241 00000100:00080000:3.0:1783137953.534721:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1783137953.534749:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e5dffbcc800: total 0 00010000:00010000:3.0:1783137953.534761:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137953.534797:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e5dffbcc800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783137953.534839:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5de2d1c400) 00010000:00010000:3.0:1783137953.534843:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137953.534852:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e02044000/0x4691dfc3d66b7fda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922955 expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137953.534876:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e5dffbcc800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783137953.534887:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137953.534889:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137953.534890:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137953.536862:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1783137953.536885:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+11:2350:x1869755299505536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137953.536910:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137953.536931:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b709f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392251f expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137953.536950:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137953.537011:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+10:2350:x1869755299505536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 137us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137953.537019:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1783137953.537050:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1783137953.537058:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+9:2350:x1869755299505664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137953.537065:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137953.537076:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030000/0x4691dfc3d66b725f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239225a4 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137953.537086:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137953.537089:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1783137953.537104:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485cbb35-9a21-40da-aa4c-96c55de41b69+7:2350:x1869755299505664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 47us (8247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137953.537110:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:3.0:1783137953.566369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783137953.566565:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506176 00000100:00100000:1.0:1783137953.566576:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506176 00000100:00100000:1.0:1783137953.566638:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 314 00000100:00100000:1.0:1783137953.566648:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+7:2349:x1869755299506176:12345-192.168.202.24@tcp:251:umount.0 00000020:00000080:1.0:1783137953.566712:0:5807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6fa3 00000020:00010000:1.0:1783137953.566722:0:5807:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e5dfa50d000: total 0 00000100:00080000:1.0:1783137953.566727:0:5807:0:(import.c:65:import_set_state_nolock()) ffff8e5dfa508000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783137953.566788:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:485cbb35-9a21-40da-aa4c-96c55de41b69+3:2349:x1869755299506176:12345-192.168.202.24@tcp:251:umount.0 Request processed in 141us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137953.566798:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 314 00000020:00010000:1.0:1783137953.566877:0:5800:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e5dfa50d000: total 0 00010000:00010000:1.0:1783137953.566928:0:5800:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e5dfa50d000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783137953.566962:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5685e00/0x4691dfc3d66b7059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239224e7 expref: 2 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137953.566979:0:5800:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e5dfa50d000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783137953.566988:0:5800:0:(genops.c:906:class_export_put()) final put ffff8e5dfa50d000/485cbb35-9a21-40da-aa4c-96c55de41b69 00010000:00010000:1.0:1783137953.567000:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137953.567002:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137953.567004:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783137953.567011:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfa50d000/485cbb35-9a21-40da-aa4c-96c55de41b69 for MGS 00000020:00000080:1.0:1783137953.567047:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dfa508000 for MGS 00000001:00100000:0.0:1783137953.571323:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:0.0:1783137953.571335:0:6642:0:(genops.c:906:class_export_put()) final put ffff8e5dc57b0000/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:3.0:1783137953.571370:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc57b0000/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-OST0000 00000020:00000080:3.0:1783137953.571442:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dc57b7000 for lustre-OST0000 00000001:00100000:1.0:1783137953.573244:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:1.0:1783137953.573254:0:7522:0:(genops.c:906:class_export_put()) final put ffff8e5dffbc8800/75742c0b-74ec-412f-af86-0dbffc92280b 00000020:00000080:2.0:1783137953.574498:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbc8800/75742c0b-74ec-412f-af86-0dbffc92280b for lustre-OST0001 00000020:00000080:2.0:1783137953.574601:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffbca800 for lustre-OST0001 00010000:00010000:2.0:1783137954.298876:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137954.492245:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322556928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137954.492315:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137954.492380:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322556928 00000100:00100000:1.0:1783137954.492387:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322556928 00000100:00100000:1.0:1783137954.492445:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783137954.492455:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322556928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137954.492491:0:6618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137954.492570:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322556928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137954.492578:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1783137954.492597:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137954.492634:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322556928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137955.323446:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783137955.579475:0:12854:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783137955.593644:0:12854:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783137955.593706:0:12854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.593724:0:12854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.593732:0:12854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.593739:0:12854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.593762:0:12854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783137955.593768:0:12854:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783137955.593812:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137955.593817:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783137955.593823:0:12854:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1783137955.593825:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137955.593832:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137955.593839:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc5685c00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137955.593842:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783137955.593846:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5dd214d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783137955.593850:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137955.593857:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137955.593863:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783137955.593867:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783137955.593869:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783137955.593896:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137955.593904:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137955.593927:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137955.593935:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc5685c00/0x4691dfc3d66b7028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b702f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137955.593955:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137955.593957:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137955.593959:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137955.593968:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137955.593987:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322557184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137955.594056:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137955.594114:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557184 00000100:00100000:1.0:1783137955.594121:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557184 00000100:00100000:1.0:1783137955.594168:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137955.594177:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3317:x1869755322557184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137955.594191:0:6630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137955.594205:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0031e00/0x4691dfc3d66b702f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b7028 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137955.594217:0:6630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137955.594250:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:3317:x1869755322557184:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137955.594258:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137955.594300:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322557184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.594364:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322557056:0@lo:39:umount.0 00000100:00100000:2.0:1783137955.594398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137955.594469:0:7189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557056 00000100:00100000:1.0:1783137955.594473:0:7189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557056 00000100:00100000:1.0:1783137955.594519:0:7189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783137955.594526:0:7189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869755322557056:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783137955.594568:0:7189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6dc0 00000100:00080000:1.0:1783137955.594578:0:7189:0:(import.c:65:import_set_state_nolock()) ffff8e5de0d4b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783137955.594629:0:7189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1869755322557056:12345-0@lo:39:umount.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137955.594643:0:7189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783137955.594651:0:7189:0:(genops.c:906:class_export_put()) final put ffff8e5de0d4a800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783137955.594674:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783137955.594683:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0d4a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783137955.594736:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5de0d4b000 for lustre-MDT0000 00000100:00080000:1.0:1783137955.594764:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dd214d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783137955.594773:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322557056:0@lo:39:umount.0 00000100:00080000:3.0:1783137955.595290:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137955.595294:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783137955.595298:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783137955.599630:0:12854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599650:0:12854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599658:0:12854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599665:0:12854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599693:0:12854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137955.599699:0:12854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599706:0:12854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599711:0:12854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599716:0:12854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599749:0:12854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137955.599757:0:12854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599762:0:12854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599768:0:12854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599773:0:12854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599781:0:12854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783137955.599786:0:12854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599792:0:12854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599808:0:12854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599814:0:12854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137955.599820:0:12854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783137955.599824:0:12854:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783137955.599829:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783137955.599837:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599844:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d4400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137955.599848:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783137955.599852:0:12854:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783137955.599857:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1783137955.599857:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783137955.599861:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137955.599867:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 10000000:00010000:2.0:1783137955.599869:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783137955.599873:0:12854:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5dfb0d5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1783137955.599875:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137955.599878:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00080000:3.0:1783137955.599880:0:12854:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e5def68c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1783137955.599880:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:3.0:1783137955.599887:0:12854:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8e5dffbcc800 59eaef08-1a40-49b6-b925-58fee4e19e35 192.168.202.24@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137955.599891:0:12854:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8e5df5f9b380) has exports, disconnecting them 00010000:00010000:2.0:1783137955.599915:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599922:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137955.599945:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599953:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d4400/0x4691dfc3d66b703d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7044 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599968:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783137955.599971:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599977:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045e00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137955.599980:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.599987:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137955.599992:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137955.600006:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137955.600007:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783137955.600009:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783137955.600022:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600028:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137955.600043:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600050:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045e00/0x4691dfc3d66b6f5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6f64 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600063:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137955.600067:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600073:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7600 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137955.600076:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600081:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137955.600087:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137955.600092:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783137955.600094:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783137955.600096:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783137955.600114:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600120:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137955.600126:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600133:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7600/0x4691dfc3d66b7251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7258 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600142:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137955.600145:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600151:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137955.600154:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600160:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137955.600167:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137955.600172:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137955.600174:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783137955.600176:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783137955.600186:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600192:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137955.600197:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600209:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e021d9200/0x4691dfc3d66b6d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b6d18 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600220:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137955.600222:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137955.600223:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137955.600241:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322557696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.600308:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137955.600351:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137955.600356:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322557312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.600377:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137955.600401:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322557440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.600422:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137955.600438:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137955.600443:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322557568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.600462:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137955.600491:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557696 00000100:00100000:2.0:1783137955.600497:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557696 00000100:00100000:2.0:1783137955.600572:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557312 00000100:00100000:2.0:1783137955.600576:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557312 00000100:00100000:2.0:1783137955.600591:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557440 00000100:00100000:2.0:1783137955.600593:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557440 00000100:00100000:2.0:1783137955.600604:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557568 00000100:00100000:2.0:1783137955.600606:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557568 00000100:00100000:2.0:1783137955.600622:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137955.600630:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc566e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+21:3316:x1869755322557696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137955.600643:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137955.600661:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5e00/0x4691dfc3d66b6d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6d11 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600675:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137955.600708:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc566e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+20:3316:x1869755322557696:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137955.600715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137955.600758:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137955.600765:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+19:3316:x1869755322557312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137955.600773:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137955.600782:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684c00/0x4691dfc3d66b7044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b703d expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600803:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137955.600826:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+18:3316:x1869755322557312:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137955.600832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137955.600845:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783137955.600851:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+17:3314:x1869755322557440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137955.600859:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137955.600866:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030800/0x4691dfc3d66b6f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6f5d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600877:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137955.600902:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+16:3314:x1869755322557440:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137955.600908:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783137955.600919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137955.600932:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+15:3314:x1869755322557568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137955.600939:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137955.600948:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6da00/0x4691dfc3d66b7258 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b7251 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137955.600957:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137955.600979:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3314:x1869755322557568:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137955.600985:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137955.601021:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322557568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.601031:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322557440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.601055:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322557312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137955.601062:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322557696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137955.601143:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137955.601150:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783137955.601405:0:12854:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5dfb0d5000), last request at 1783137951 00000020:00000080:3.0:1783137955.601413:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6f25 00000100:00080000:3.0:1783137955.601558:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783137955.601616:0:12854:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5dfb0d5000): rc 0 00000020:00000080:3.0:1783137955.601619:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dfb0d5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783137955.601636:0:12854:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e5def68c800), last request at 1783137951 00010000:00010000:2.0:1783137955.601636:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137955.601640:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6e5a 00000100:00080000:3.0:1783137955.601647:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5def68d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783137955.601664:0:12854:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5def68c800): rc 0 00000020:00000080:3.0:1783137955.601666:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5def68c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783137955.601668:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfb0d5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000004:00000080:3.0:1783137955.601678:0:12854:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab14c0d7fae0 00000100:00080000:3.0:1783137955.601700:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783137955.601704:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000020:00000080:1.0:1783137955.601707:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5def68c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00080000:3.0:1783137955.601715:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1783137955.601725:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dfb0d1000 for lustre-MDT0000 00000020:00000080:1.0:1783137955.601729:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5def68d800 for lustre-MDT0000 00010000:00010000:2.0:1783137955.601769:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137955.601775:0:12854:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783137955.601793:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5dd214b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783137955.601823:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783137955.601825:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1783137955.601839:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783137955.601845:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322557824:0@lo:9:umount.0 00000100:00100000:1.0:1783137955.601890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137955.601933:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557824 00000100:00100000:1.0:1783137955.601939:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557824 00000100:00100000:1.0:1783137955.601976:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783137955.601984:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869755322557824:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783137955.602006:0:6615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ea7 00000100:00080000:1.0:1783137955.602011:0:6615:0:(import.c:65:import_set_state_nolock()) ffff8e5dffd06800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137955.602042:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783137955.602362:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1869755322557824:12345-0@lo:9:umount.0 Request processed in 377us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137955.602369:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1783137955.602388:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783137955.602423:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dd214b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783137955.602432:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783137955.602434:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783137955.602438:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322557824:0@lo:9:umount.0 00000100:00080000:3.0:1783137955.602999:0:12854:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783137955.603023:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5c05800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783137955.603066:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e5df5f9b380) has no exports 00000100:00100000:2.0:1783137955.603412:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322557952:0@lo:9:umount.0 00000100:00100000:2.0:1783137955.603459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137955.603501:0:6616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322557952 00000100:00100000:2.0:1783137955.603519:0:6616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322557952 00000100:00100000:2.0:1783137955.603591:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137955.603601:0:6616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869755322557952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783137955.603621:0:6616:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6f8e 00000100:00080000:2.0:1783137955.603628:0:6616:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137955.603654:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783137955.603937:0:6616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3313:x1869755322557952:12345-0@lo:9:umount.0 Request processed in 336us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137955.603951:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783137955.603989:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5c05800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783137955.603998:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783137955.604000:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137955.604003:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322557952:0@lo:9:umount.0 00010000:00010000:2.0:1783137955.604025:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783137955.604281:0:5808:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1783137955.623263:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e5df5f9b380) has no exports 00000020:00000080:3.0:1783137955.679064:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d6c 00000020:00000080:3.0:1783137955.679082:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5fa5800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783137955.679107:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783137955.679477:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5fa5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783137955.679503:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137955.679511:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783137955.679514:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8e5dc7ec99c0) has no exports 00000020:00000080:2.0:1783137955.679769:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d65 00000020:00000080:2.0:1783137955.679775:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dfb15c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783137955.679834:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfb15c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783137955.679843:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137955.679850:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783137955.679853:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dfb15a000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783137955.679855:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfb15a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783137955.679860:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1783137956.347086:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137956.539038:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322558208:0@lo:400:kworker.0 00000100:00100000:0.0:1783137956.539115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137956.539199:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137956.539205:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322558336:0@lo:400:kworker.0 00000100:00100000:0.0:1783137956.539244:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137956.539321:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322558080:0@lo:400:kworker.0 00000100:00100000:2.0:1783137956.539354:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137956.539450:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558080 00000100:00100000:0.0:1783137956.539459:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558080 00000100:00100000:0.0:1783137956.539505:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1783137956.539514:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3317:x1869755322558080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137956.539585:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3317:x1869755322558080:12345-0@lo:400:kworker.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137956.539593:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783137956.539683:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83444777-5c31-482f-a1f5-fb6cbc8d0848:3317:1869755322558080:0@lo:400:kworker.0 00000100:00100000:3.0:1783137956.539901:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558208 00000100:00100000:3.0:1783137956.539905:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558208 00000100:00100000:3.0:1783137956.539937:0:11954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558336 00000100:00100000:3.0:1783137956.539940:0:11954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558336 00000100:00100000:3.0:1783137956.539965:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783137956.539971:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1869755322558208:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783137956.539977:0:11954:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783137956.540014:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1869755322558208:12345-0@lo:400:kworker.0 Request processed in 42us (899us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783137956.540020:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783137956.540033:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783137956.540037:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1869755322558336:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783137956.540042:0:11954:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783137956.540064:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1869755322558336:12345-0@lo:400:kworker.0 Request processed in 25us (820us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783137956.540070:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1783137956.540144:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783137956.540149:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783137956.540153:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783137956.547783:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783137956.547814:0:3314:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 230 00000100:00080000:0.0:1783137956.547826:0:3314:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5dfb0d6800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137956.547875:0:3314:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347d880 x1869755322558464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783137956.547981:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322558464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783137956.548067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137956.548178:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558464 00000100:00100000:3.0:1783137956.548187:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558464 00000100:00100000:3.0:1783137956.548241:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783137956.548249:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322558464:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1783137956.548268:0:5811:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783137956.551838:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dff7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322558336:0@lo:400:kworker.0 00000100:00080000:0.0:1783137956.551884:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783137956.551890:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783137956.551894:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783137956.551899:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783137956.551903:0:3314:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1783137956.551911:0:3314:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5dffbcc000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137956.551964:0:3314:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347d180 x1869755322558592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783137956.552994:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322558592:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783137956.553073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137956.553305:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322558464:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 5054us (5236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783137956.553346:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783137956.553374:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558592 00000100:00100000:3.0:1783137956.553381:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558592 00000100:00100000:3.0:1783137956.553415:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783137956.553422:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322558592:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1783137956.553440:0:5811:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783137956.553489:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322558592:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 66us (417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783137956.553496:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783137956.554553:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322558208:0@lo:400:kworker.0 00000100:00080000:2.0:1783137956.554768:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783137956.554775:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783137956.554825:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322558464:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1783137956.558496:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783137956.558509:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783137956.558515:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322558592:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1783137957.370910:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783137958.124629:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59eaef08-1a40-49b6-b925-58fee4e19e35 00000001:00080000:1.0:1783137958.124647:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1783137958.124653:0:5833:0:(genops.c:906:class_export_put()) final put ffff8e5dffbcc800/59eaef08-1a40-49b6-b925-58fee4e19e35 00000020:00000080:1.0:1783137958.124683:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbcc800/59eaef08-1a40-49b6-b925-58fee4e19e35 for lustre-MDT0000 00000020:00000080:1.0:1783137958.124733:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffbcf000 for lustre-MDT0000 00010000:00010000:2.0:1783137958.395421:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783137958.675487:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783137958.675497:0:7522:0:(genops.c:906:class_export_put()) final put ffff8e5dfb0d7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783137958.677031:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfb0d7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783137958.677101:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dfb0d0800 for lustre-OST0001 00000001:00100000:0.0:1783137958.703072:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783137958.703085:0:6642:0:(genops.c:906:class_export_put()) final put ffff8e5dffd02000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783137958.703120:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffd02000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783137958.703169:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffd06800 for lustre-OST0000 00010000:00010000:2.0:1783137959.419848:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137960.442762:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137961.467076:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137961.659150:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137961.659158:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783137961.659162:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137961.659170:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1783137961.659175:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783137961.659182:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5dffbcc000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783137961.659203:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5cc9c00 x1869755322558848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137961.659224:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137961.659227:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783137961.659229:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137961.659232:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1783137961.659235:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783137961.659237:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5dfb0d6800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783137961.659261:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5cca680 x1869755322558976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783137961.659320:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322558720:0@lo:400:kworker.0 00000100:00100000:2.0:1783137961.659388:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137961.659517:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322558848:0@lo:38:kworker.0 00000100:00100000:1.0:1783137961.659564:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137961.659588:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322558976:0@lo:38:kworker.0 00000100:00100000:1.0:1783137961.659606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137961.659667:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558848 00000100:00100000:2.0:1783137961.659674:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558848 00000100:00100000:2.0:1783137961.659706:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558976 00000100:00100000:2.0:1783137961.659709:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558976 00000100:00100000:2.0:1783137961.659722:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783137961.659729:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869755322558848:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1783137961.659756:0:5813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783137961.660906:0:11954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783137961.660914:0:11954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1869755322558976:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1783137961.660924:0:11954:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783137961.660986:0:11954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1869755322558976:12345-0@lo:38:kworker.0 Request processed in 71us (1378us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783137961.660993:0:11954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1783137961.661037:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783137961.661042:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783137961.661045:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322558976:0@lo:38:kworker.0 00000100:00100000:3.0:1783137961.661625:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322558720 00000100:00100000:3.0:1783137961.661631:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322558720 00000100:00100000:3.0:1783137961.661672:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1783137961.661677:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3316:x1869755322558720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137961.661723:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83444777-5c31-482f-a1f5-fb6cbc8d0848+14:3316:x1869755322558720:12345-0@lo:400:kworker.0 Request processed in 46us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137961.661727:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783137961.661845:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322558720:0@lo:400:kworker.0 00000100:00100000:2.0:1783137961.666227:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dff7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869755322558848:12345-0@lo:38:kworker.0 Request processed in 6486us (6650us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783137961.666243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1783137961.666288:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783137961.666296:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783137961.666300:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322558848:0@lo:38:kworker.0 00000020:01000000:2.0:1783137961.722684:0:12854:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dd0b0ec00 - data ffff8e5dc77db438/ffff8e5dd02d7c00 00000020:01000000:2.0:1783137961.722826:0:12854:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dc8742240 - data ffff8e5dc21a5798/ffff8e5dc602f000 00000001:00000004:2.0:1783137961.732985:0:12854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1783137961.867362:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783137961.867381:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783137961.867393:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137961.867407:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783137961.868178:0:6761:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783137961.868184:0:6761:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1783137961.868194:0:6761:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783137961.869192:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783137961.869199:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783137961.869222:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137961.869224:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783137961.873677:0:7799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783137961.873687:0:7799:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1783137961.873706:0:7799:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1783137961.947876:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d34 00000020:00000080:0.0:1783137961.947893:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5de0d4e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783137961.948024:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0d4e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783137961.961889:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d49 00000020:00000080:1.0:1783137961.961905:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5fa7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783137961.961922:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783137961.961942:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137961.961952:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783137961.961956:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8e5df5f98000) has no exports 00000004:01000000:1.0:1783137961.962153:0:12854:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783137961.962165:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6f87 00000020:00000080:1.0:1783137961.962169:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dfa50d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783137961.962174:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783137961.962178:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137961.962185:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783137961.962187:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8e5df5e48000) has no exports 00000020:00000080:1.0:1783137961.962195:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6f80 00000020:00000080:1.0:1783137961.962198:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dff9dd800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783137961.962593:0:12854:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783137961.962599:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783137961.962604:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1783137961.962611:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783137961.962614:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783137961.962649:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137961.962656:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783137961.962662:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ea0 00000020:00000080:1.0:1783137961.962667:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dffbc9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783137961.962670:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783137961.962673:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137961.962676:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783137961.962678:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8e5df5c0cd40) has no exports 00000020:00000080:1.0:1783137961.962682:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6e99 00000020:00000080:1.0:1783137961.962684:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dff9d8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783137961.963231:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5fa7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783137961.963242:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfa50d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783137961.963247:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783137961.963255:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dc5c05800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783137961.963269:0:38:0:(genops.c:906:class_export_put()) final put ffff8e5def689800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783137961.963271:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5def689800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783137961.963275:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783137961.963367:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbc9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783137961.963371:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783137961.965103:0:12854:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783137961.965110:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783137961.965115:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783137961.965123:0:12854:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783137961.965125:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783137961.965233:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137961.965244:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783137961.965274:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137961.965277:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783137961.965283:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5de0d4c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783137961.965287:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0d4c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783137961.965304:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783137961.965473:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d50 00000020:00000080:1.0:1783137961.965480:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5fa0000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783137961.967075:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dd214b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783137961.967093:0:38:0:(genops.c:906:class_export_put()) final put ffff8e5dff9de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783137961.967096:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783137961.967104:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783137961.967517:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783137961.967527:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137961.967538:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783137961.967554:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8e5df5f999c0) has no exports 00000020:00000080:1.0:1783137961.967597:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137961.967604:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783137961.967612:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6d57 00000020:00000080:1.0:1783137961.967619:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5fa7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783137961.972987:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5fa0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783137961.973002:0:38:0:(genops.c:906:class_export_put()) final put ffff8e5dd214c800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783137961.973005:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dd214c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783137961.973013:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1783137961.975991:0:12854:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dd09a3000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783137961.976002:0:12854:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dd09a3000 3 00000020:01000004:1.0:1783137961.976006:0:12854:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5dd09a3000 from lustre-MDT0000 00000020:00000080:1.0:1783137961.976037:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137961.976050:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783137961.976056:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5de0d48800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783137961.976060:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0d48800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783137961.976081:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1783137961.976869:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5fa7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783137961.982539:0:12854:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1783137961.982574:0:12854:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783137961.982581:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783137961.982590:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137961.982595:0:12854:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783137961.982605:0:12854:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8e5dc5dc3000 83444777-5c31-482f-a1f5-fb6cbc8d0848 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783137961.982613:0:12854:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8e5dc7ecb380) has exports, disconnecting them 00000020:00080000:1.0:1783137961.982631:0:12854:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e5dc5dc3000), last request at 1783137701 00000020:00000080:1.0:1783137961.982649:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6cf5 00000020:00010000:1.0:1783137961.982656:0:12854:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e5dc5dc3000: total 0 00000100:00080000:1.0:1783137961.982660:0:12854:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783137961.982679:0:12854:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5dc5dc3000): rc 0 00000020:00080000:1.0:1783137961.982685:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8e5dc7ecb380) has no exports 00000100:00100000:0.0:1783137961.982865:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e5dc5d0e000:5807] 2 exiting: rc = 0 00000100:00100000:0.0:1783137961.982980:0:5806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e5dc5da8e00:5806] 1 exiting: rc = 0 00000020:00010000:2.0:1783137961.983256:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e5dc5dc3000: total 0 00010000:00010000:2.0:1783137961.983316:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e5dc5dc3000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1783137961.983349:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5200/0x4691dfc3d66b7005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6ffe expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983378:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5685000/0x4691dfc3d66b7013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b700c expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983394:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684400/0x4691dfc3d66b7052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b704b expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983409:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc0030400/0x4691dfc3d66b723c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b7235 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983421:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d4000/0x4691dfc3d66b7021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b701a expref: 5 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983433:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5684a00/0x4691dfc3d66b724a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b7243 expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983449:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc29d5a00/0x4691dfc3d66b6e0d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6e06 expref: 3 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983462:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dc5685600/0x4691dfc3d66b6ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4691dfc3d66b6ff0 expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137961.983474:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e5dc5dc3000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1783137961.983495:0:5801:0:(genops.c:906:class_export_put()) final put ffff8e5dc5dc3000/83444777-5c31-482f-a1f5-fb6cbc8d0848 00010000:00010000:2.0:1783137961.983514:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137961.983517:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137961.983518:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783137961.983778:0:1386:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc5dc3000/83444777-5c31-482f-a1f5-fb6cbc8d0848 for MGS 00000020:00000080:0.0:1783137961.983816:0:1386:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dc5dc6000 for MGS 00000100:00100000:3.0:1783137961.984785:0:5805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e5dc5d0fc00:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1783137961.984864:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984873:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984879:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984884:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984889:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984896:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984901:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984907:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984914:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984919:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984924:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984929:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984934:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984940:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984945:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984952:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984957:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984962:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984968:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984973:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984979:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984985:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984991:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.984998:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985005:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985011:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985016:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985023:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985044:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985051:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985057:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985062:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985067:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985072:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985077:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985082:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985087:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985092:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985097:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985102:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985107:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985112:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985118:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985123:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985129:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985134:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985138:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985458:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985468:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985473:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985479:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985484:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985489:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985494:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985500:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985505:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985510:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985515:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985521:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985526:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985532:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985537:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985687:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137961.985702:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1783137961.988328:0:12854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137961.988337:0:12854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1783137961.989967:0:12854:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dc7f9b0c0 - data ffff8e5dee7af870/ffff8e5dfb095800 00000020:01000000:2.0:1783137961.990093:0:12854:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dd85aa900 - data ffff8e5dd77f0360/ffff8e5dc5d87c00 00000020:00000080:2.0:1783137961.992193:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6cd9 00000020:00000080:2.0:1783137961.992204:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dc32bd800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783137961.992278:0:12854:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dd09a3000 from MGS, refs=2 00000020:01000004:2.0:1783137961.992282:0:12854:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dd09a3000 2 00000020:01000004:2.0:1783137961.992285:0:12854:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5dd09a3000 from MGS 00000020:00000080:2.0:1783137961.992318:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137961.992325:0:12854:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783137961.992328:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5de0f5a800/MGS 00000020:00000080:2.0:1783137961.992331:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0f5a800/MGS for MGS 00000020:01000000:2.0:1783137961.992343:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783137961.992540:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783137961.992567:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137961.992573:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783137961.992579:0:12854:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e5df5be7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783137961.992585:0:12854:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8e5df5f9cd40) has exports, disconnecting them 00000020:00080000:2.0:1783137961.992589:0:12854:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e5df5be7000), last request at 1783137702 00000020:00000080:2.0:1783137961.992593:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6da4 00000020:00080000:2.0:1783137961.992602:0:12854:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5df5be7000): rc 0 00000020:00000080:2.0:1783137961.992606:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5be7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783137961.995207:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc32bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783137961.998092:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5be7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783137962.049066:0:12854:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783137962.049076:0:12854:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783137962.049080:0:12854:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783137962.049089:0:12854:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783137962.049271:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137962.049274:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dd214d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783137962.049280:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783137962.049287:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5df5fa4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783137962.049291:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5fa4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783137962.049304:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783137962.049398:0:12854:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dd09a3000 1 00000020:00000080:0.0:1783137962.049404:0:12854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ccb 00000020:00000080:0.0:1783137962.049412:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5de0f5d000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783137962.049425:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783137962.049430:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137962.049435:0:12854:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783137962.049440:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8e5dc7ef0000) has no exports 00000020:00000080:1.0:1783137962.049455:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5de0f5d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783137962.124515:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783137962.124532:0:12854:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783137962.124538:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dc928e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783137962.124561:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc928e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783137962.124572:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783137962.124717:0:12854:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e5dc928c000 00000020:01000000:0.0:1783137962.124767:0:12854:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783137962.124773:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137962.124778:0:12854:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783137962.124783:0:12854:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8e5dc5dd4d40) has no exports 00000100:00100000:0.0:1783137962.124885:0:11954:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8e5dd2101c00:11954] 4 exiting: rc = 0 00000100:00100000:1.0:1783137962.125056:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8e5dc5645400:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1783137962.125133:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8e5dc5de5000:5811] 0 exiting: rc = 1 00000100:00100000:3.0:1783137962.125214:0:7189:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8e5dc5f6ec00:7189] 3 exiting: rc = 0 00000100:00100000:2.0:1783137962.129190:0:5813:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8e5dc5645600:5813] 2 exiting: rc = 0 00000100:00100000:0.0:1783137962.129704:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129713:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129718:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129723:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129808:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129817:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129823:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129829:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129834:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129850:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129859:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129864:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129869:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129875:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129880:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129904:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129910:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129916:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129923:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129929:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129935:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129940:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129946:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129952:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129957:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.129962:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130046:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130056:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130062:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130068:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130075:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130080:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130085:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130092:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130098:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130104:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130109:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130115:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130122:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130127:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130132:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130139:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130146:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130153:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130159:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130165:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130169:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130175:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130180:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130185:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130199:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130205:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130211:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130217:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130223:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130229:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130365:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130371:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130377:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130384:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130390:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130402:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130411:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.130428:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137962.138661:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e5dc5644600:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1783137962.138767:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e5dc5645e00:5815] 1 exiting: rc = 0 00000100:00100000:0.0:1783137962.138921:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138930:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138937:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138943:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138950:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138955:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138961:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138969:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138974:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138980:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138985:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138991:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.138998:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139004:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139009:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139014:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139019:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139024:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139029:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139033:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139038:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139058:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139064:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139069:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139074:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139078:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139083:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139088:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139092:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139097:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139102:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139107:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139112:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139117:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139121:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139125:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139129:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139134:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139139:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139144:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139148:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139153:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139157:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139161:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139166:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139172:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139176:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139181:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139186:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139191:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139201:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139208:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139213:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139218:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139223:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139228:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139241:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139245:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139251:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139256:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139260:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139266:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139271:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.139276:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.139948:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8e5dc977fa00:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1783137962.143094:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8e5dc61e3400:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1783137962.143819:0:12413:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8e5dff948800:12413] 2 exiting: rc = 0 00000100:00100000:0.0:1783137962.144105:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144124:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144130:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144135:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144141:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144147:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144153:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144158:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144164:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144169:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144174:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144179:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144185:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144202:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144209:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144215:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144220:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144226:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144231:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144254:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144260:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144267:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144274:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144280:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144440:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144461:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144469:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144487:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144493:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144499:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144507:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144513:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144519:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144524:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144530:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144535:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.144541:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148489:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148501:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148508:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148515:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148522:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148530:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148536:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148542:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148605:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148611:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148617:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148623:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148644:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148652:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148658:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148665:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148671:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148677:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148683:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148690:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148697:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148703:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148709:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148716:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.148723:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.150086:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.150106:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.166854:0:7804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0002: service thread [ffff8e5dfa412000:7804] 2 exiting: rc = 0 00000100:00100000:2.0:1783137962.166995:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e5dc9760800:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1783137962.167706:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e5dc9761600:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1783137962.167790:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167798:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167803:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167808:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167814:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167821:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167826:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167831:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167845:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167851:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167856:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167861:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167866:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167870:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167875:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167880:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167885:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167889:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167894:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167900:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167904:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167910:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167917:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167922:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167926:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167931:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167936:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167950:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167954:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167960:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167972:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167977:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167983:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.167988:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168004:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168009:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168014:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168019:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168024:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168029:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168034:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168039:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168044:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168050:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168054:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168059:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168064:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168069:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168074:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168079:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168083:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168088:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168093:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168098:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168104:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168108:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168114:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168118:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168123:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168128:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168133:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168137:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168142:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168147:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168480:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e5dc5df3000:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1783137962.168519:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e5df947e600:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1783137962.168754:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168760:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168765:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168770:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168784:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168789:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168795:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168801:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168806:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168811:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168817:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168823:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168828:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168833:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168839:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168843:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168848:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168853:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168857:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168861:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168865:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168868:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168871:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168874:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168877:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168881:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168884:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168887:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168890:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168893:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168895:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168898:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168901:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168903:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168906:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168909:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168912:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168914:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168918:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168927:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168930:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168933:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168937:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168940:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168943:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168947:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168950:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168953:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.168956:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169001:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169006:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169009:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169012:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169015:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169018:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169022:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169025:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169028:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169031:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169034:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169037:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169039:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169042:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.169045:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.169362:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e5dc5df3800:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1783137962.169911:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e5dc5df3400:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1783137962.173788:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173800:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173807:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173812:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173818:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173823:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173829:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173835:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173850:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173855:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173875:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173879:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173882:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173885:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173888:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173892:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173895:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173897:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173900:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173903:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173906:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173909:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173913:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173915:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173918:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173921:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173925:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173928:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173931:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173934:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173937:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173940:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173950:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173954:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173958:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173961:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173969:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173972:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173976:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173980:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173983:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173987:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173991:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173994:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.173998:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174006:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174009:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174012:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174016:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174019:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174023:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174026:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174029:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174032:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174035:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174038:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174041:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174043:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174046:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174050:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174052:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174055:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174058:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.174061:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137962.174673:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8e5dc9761a00:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1783137962.174960:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8e5df947f600:5826] 2 exiting: rc = 0 00000100:00100000:1.0:1783137962.175208:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8e5df947f800:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1783137962.176771:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176782:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176788:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176794:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176801:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176807:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176814:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176823:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176831:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176849:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176857:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176863:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176869:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176875:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176906:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176913:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.176932:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177101:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177111:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177116:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177121:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177127:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177133:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177139:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177143:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177148:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177153:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177158:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177163:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177168:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177174:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177180:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177186:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177191:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177196:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177202:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177207:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177212:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177234:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177241:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177247:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177252:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177257:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177263:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177271:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177277:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177283:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177288:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177298:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177304:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177309:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177322:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177328:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177334:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177340:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177346:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177351:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177357:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177362:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177368:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177439:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177449:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177455:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137962.177461:0:12854:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783137962.193072:0:12854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137962.193083:0:12854:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783137962.193087:0:12854:0:(genops.c:906:class_export_put()) final put ffff8e5dea33a800/MDS_uuid 00000020:00000080:2.0:1783137962.193091:0:12854:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dea33a800/MDS_uuid for MDS 00000020:01000000:2.0:1783137962.193100:0:12854:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783137962.193245:0:12854:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783137962.497785:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137963.514964:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137964.540123:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783137964.945367:0:13007:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783137964.968714:0:13007:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783137964.968774:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.968790:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.968799:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.968807:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.968831:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783137964.968837:0:13007:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783137964.968856:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137964.968861:0:13007:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783137964.968881:0:13007:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783137964.968887:0:13007:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783137964.968892:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137964.968894:0:13007:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783137964.968897:0:13007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783137964.972245:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137964.972256:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.972267:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d5400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137964.972272:0:7510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.972283:0:7510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137964.972290:0:7510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137964.972296:0:7510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137964.972299:0:7510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783137964.972302:0:7510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783137964.972339:0:7510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.972346:0:7510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137964.972379:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.972404:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5400/0x4691dfc3d66b700c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7013 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.972417:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137964.972418:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137964.972420:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137964.972428:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137964.972445:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322559104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137964.972509:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137964.972651:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322559104 00000100:00100000:2.0:1783137964.972658:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322559104 00000100:00100000:2.0:1783137964.972701:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783137964.972708:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1869755322559104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783137964.972714:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783137964 with bad export cookie 5085091486486981877 00010000:00010000:3.0:1783137964.974739:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974757:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974766:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974773:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974797:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137964.974804:0:13007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974810:0:13007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974815:0:13007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974821:0:13007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137964.974855:0:13007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783137964.974859:0:13007:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783137964.974890:0:13007:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783137964.974894:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783137964.974899:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137964.974904:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783137964.974908:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e5dc7ec8000) has no exports 00000020:00080000:3.0:1783137964.974933:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e5dc7ec8000) has no exports 00000020:01000000:3.0:1783137964.976752:0:13007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dfb1419c0 - data ffff8e5dee784870/ffff8e5df5c46c00 00000020:01000000:3.0:1783137964.976915:0:13007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dd81c0360 - data ffff8e5dd0db5870/ffff8e5dc5a62c00 00010000:00010000:0.0:1783137964.977258:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137964.977268:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977279:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6a00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137964.977283:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977294:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137964.977301:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137964.977306:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137964.977309:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783137964.977312:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783137964.977356:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977383:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137964.977421:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977429:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b701a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b7021 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977442:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137964.977447:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977452:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d200 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:0.0:1783137964.977455:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977463:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137964.977469:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137964.977474:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783137964.977476:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783137964.977478:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783137964.977491:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977497:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137964.977503:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977519:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d200/0x4691dfc3d66b7243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4691dfc3d66b724a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137964.977528:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137964.977529:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137964.977531:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137964.977567:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322559232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137964.977641:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137964.977692:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137964.977698:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322559360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137964.977732:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137964.981427:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1869755322559104:12345-0@lo:103:ldlm_bl.0 Request processed in 8708us (8908us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783137964.981441:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783137964.981471:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322559232 00000100:00100000:2.0:1783137964.981478:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322559232 00000100:00100000:2.0:1783137964.981508:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322559360 00000100:00100000:2.0:1783137964.981511:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322559360 00000100:00100000:2.0:1783137964.981539:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137964.981696:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1869755322559232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783137964.981704:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783137964 with bad export cookie 5085091486486981877 00000100:00100000:2.0:1783137964.981793:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1869755322559232:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (4152us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783137964.981801:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137964.981814:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137964.981818:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1869755322559360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783137964.981823:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783137964 with bad export cookie 5085091486486981877 00000100:00100000:2.0:1783137964.981859:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1869755322559360:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (4126us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783137964.981865:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1783137964.981895:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783137964.982180:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783137964.982187:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8e5dea33c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783137964.982190:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783137964.988775:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783137964.993233:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.124@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783137964.993239:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783137964.993250:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5cc347d500 x1869755322559104/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783137980 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137964.993266:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5cc347ed80 x1869755322559232/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783137980 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137964.993275:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5cc347c380 x1869755322559360/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783137980 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783137964.993298:0:3314:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e5dea33c800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1783137964.993424:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322559360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137964.993432:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83444777-5c31-482f-a1f5-fb6cbc8d0848:3314:1869755322559232:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1783137964.998058:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783137964.998067:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783137964.998069:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783137964.998074:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8e5dea33c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783137964.998083:0:3316:0:(import.c:512:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 191 00000100:00080000:1.0:1783137964.998095:0:3316:0:(import.c:626:import_select_connection()) MGC192.168.202.124@tcp: import ffff8e5dea33c800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783137964.998134:0:3316:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5dffe38e00 x1869755322559488/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137964.998189:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83444777-5c31-482f-a1f5-fb6cbc8d0848:3316:1869755322559104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137964.998245:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83444777-5c31-482f-a1f5-fb6cbc8d0848:3313:1869755322559488:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1783137964.998413:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755322559488 offset 0 length 520: 4 00100000:10000000:2.0:1783137965.011465:0:13007:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783137965.087706:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6e29 00000020:00000080:0.0:1783137965.087730:0:13007:0:(genops.c:906:class_export_put()) final put ffff8e5dff9de800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1783137965.087749:0:13007:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dc5ce5000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1783137965.087753:0:13007:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5ce5000 2 00000020:01000004:0.0:1783137965.087755:0:13007:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5dc5ce5000 from lustre-OST0000 00000020:00000080:0.0:1783137965.087779:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783137965.087788:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1783137965.087792:0:13007:0:(genops.c:906:class_export_put()) final put ffff8e5dc5c08800/lustre-OST0000_UUID 00000020:00000080:0.0:1783137965.087795:0:13007:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc5c08800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1783137965.087801:0:13007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1783137965.087856:0:13007:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1783137965.087861:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783137965.087865:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137965.087869:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783137965.087886:0:13007:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e5dffb61800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783137965.087891:0:13007:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8e5dc7ef3380) has exports, disconnecting them 00000020:00080000:0.0:1783137965.087896:0:13007:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e5dffb61800), last request at 1783137720 00000020:00000080:0.0:1783137965.087899:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6e53 00000020:00080000:0.0:1783137965.087911:0:13007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5dffb61800): rc 0 00000020:00000080:0.0:1783137965.087917:0:13007:0:(genops.c:906:class_export_put()) final put ffff8e5dffb61800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783137965.088736:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9de800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783137965.088749:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffb61800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783137965.089088:0:13007:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783137965.089094:0:13007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783137965.089099:0:13007:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783137965.089105:0:13007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783137965.089343:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783137965.089351:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1783137965.089356:0:13007:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5ce5000 1 00000020:00000080:0.0:1783137965.089361:0:13007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6de3 00000020:00000080:0.0:1783137965.089367:0:13007:0:(genops.c:906:class_export_put()) final put ffff8e5dc44d5800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783137965.089621:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dffbcc000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783137965.089629:0:38:0:(genops.c:906:class_export_put()) final put ffff8e5dffbcd800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783137965.089631:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dffbcd800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783137965.089636:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783137965.089772:0:13007:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783137965.089777:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137965.089782:0:13007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783137965.089785:0:13007:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8e5dc5dd0000) has no exports 00000020:00000080:3.0:1783137965.090163:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc44d5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783137965.101866:0:13007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137965.101882:0:13007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783137965.101888:0:13007:0:(genops.c:906:class_export_put()) final put ffff8e5dc5ce1000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783137965.101893:0:13007:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc5ce1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783137965.101905:0:13007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783137965.102049:0:13007:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e5dc5ce3000 00000020:02000400:3.0:1783137965.102095:0:13007:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783137965.562978:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137966.586695:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783137966.784934:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 83444777-5c31-482f-a1f5-fb6cbc8d0848->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783137966.784944:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 83444777-5c31-482f-a1f5-fb6cbc8d0848->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783137966.784947:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783137966.784951:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783137966.784955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783137966.784963:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1783137966.784968:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783137966.784975:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5dfb0d6800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783137966.785014:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5dffe39880 x1869755322559616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137966.785057:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322559616:0@lo:38:kworker.0 00000400:00000100:1.0:1783137966.785111:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755322559616 offset 0 length 520: 4 00010000:00010000:2.0:1783137967.615274:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783137967.771504:0:13157:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783137967.789854:0:13157:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1783137967.789956:0:13157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.789971:0:13157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.789979:0:13157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.789986:0:13157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.790005:0:13157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783137967.790010:0:13157:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783137967.790031:0:13157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137967.790044:0:13157:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5dffe39880 x1869755322559616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783137986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137967.790109:0:13157:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783137967.790116:0:13157:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783137967.790122:0:13157:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783137967.790128:0:13157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137967.790132:0:13157:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5dffe39880 x1869755322559616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783137986 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783137967.790210:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137967.790218:0:7510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137967.790226:0:7510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031c00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783137967.790229:0:7510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137967.790238:0:7510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137967.790265:0:7510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137967.790271:0:7510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783137967.790273:0:7510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783137967.790275:0:7510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783137967.790288:0:7510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e5dea33c800 00010000:00010000:1.0:1783137967.790292:0:7510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137967.790299:0:7510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc0031c00/0x4691dfc3d66b6ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b6ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137967.790310:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137967.790312:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137967.790314:0:7510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137967.790767:0:13157:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783137967.790846:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322559616:0@lo:38:kworker.0 00000100:00100000:3.0:1783137967.790923:0:13157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783137967.793240:0:13157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793259:0:13157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793281:0:13157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793288:0:13157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793353:0:13157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137967.793361:0:13157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793369:0:13157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793376:0:13157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.793380:0:13157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793486:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137967.793493:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793501:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc29d5600 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137967.793504:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793513:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137967.793525:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137967.793529:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137967.793531:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1783137967.793540:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e5dea33c800 00010000:00010000:2.0:1783137967.793569:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793584:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dc29d5600/0x4691dfc3d66b6ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b7005 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793596:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137967.793599:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793604:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783137967.793606:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793612:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137967.793618:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137967.793622:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783137967.793624:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783137967.793628:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e5dea33c800 00010000:00010000:2.0:1783137967.793637:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793645:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137967.793647:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137967.793649:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137967.793777:0:13157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783137967.793782:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6c000/0x4691dfc3d66b7235 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b723c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137967.793784:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783137967.793795:0:13157:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1783137967.793800:0:13157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1783137967.793803:0:13157:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1783137967.793823:0:13157:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1783137967.793828:0:13157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1783137967.793833:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137967.793843:0:13157:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783137967.793848:0:13157:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e5dc7ef19c0) has no exports 00000020:00080000:3.0:1783137967.793868:0:13157:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e5dc7ef19c0) has no exports 00000020:01000000:3.0:1783137967.796073:0:13157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dfb1412a0 - data ffff8e5dee7845e8/ffff8e5dff788400 00000020:01000000:3.0:1783137967.796817:0:13157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e5dd9e57480 - data ffff8e5dc7420870/ffff8e5dffdfd400 00100000:10000000:3.0:1783137967.809887:0:13157:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783137967.853156:0:13157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ef4 00000020:00000080:3.0:1783137967.853166:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dc5c03000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783137967.853221:0:13157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dc5c0e000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783137967.853225:0:13157:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5c0e000 2 00000020:01000004:3.0:1783137967.853228:0:13157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e5dc5c0e000 from lustre-OST0001 00000020:00000080:3.0:1783137967.853251:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137967.853261:0:13157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783137967.853265:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dff9da800/lustre-OST0001_UUID 00000020:00000080:3.0:1783137967.853268:0:13157:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dff9da800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783137967.853276:0:13157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783137967.853409:0:13157:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 83444777-5c31-482f-a1f5-fb6cbc8d0848->MGS 00010000:00010000:3.0:1783137967.853425:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137967.853436:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137967.853443:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783137967.853446:0:13157:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783137967.853449:0:13157:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783137967.853464:0:13157:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e5dea33c800 00010000:00010000:3.0:1783137967.853468:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b6e06 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b6e0d expref: -99 pid: 6612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137967.853484:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137967.853501:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137967.853506:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783137967.853508:0:13157:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783137967.853509:0:13157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783137967.853520:0:13157:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e5dea33c800 00010000:00010000:3.0:1783137967.853523:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b704b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4691dfc3d66b7052 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783137967.853539:0:13157:0:(import.c:65:import_set_state_nolock()) ffff8e5dea33c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783137967.853666:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783137967.853670:0:13157:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783137967.853672:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783137967.853676:0:13157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783137967.853688:0:13157:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e5dffe38e00 x1869755322559488/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783137974 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783137967.853718:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783137967.853721:0:13157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1783137967.853789:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83444777-5c31-482f-a1f5-fb6cbc8d0848:3313:1869755322559488:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1783137967.853934:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783137967.853941:0:13157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ce7 00000020:00000080:3.0:1783137967.853947:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dea33d800/83444777-5c31-482f-a1f5-fb6cbc8d0848 00000020:00000080:2.0:1783137967.854085:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc5c03000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1783137967.854158:0:13157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.124@tcp (flags='') 00000020:00000080:3.0:1783137967.854165:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137967.854170:0:13157:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783137967.854175:0:13157:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8e5dc5dd19c0) has no exports 10000000:01000000:0.0:1783137967.854238:0:5809:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783137967.854327:0:13157:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.124@tcp: client import never connected 00000100:00080000:3.0:1783137967.854330:0:13157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783137967.854333:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783137967.854335:0:13157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783137967.854343:0:13157:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783137967.854369:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dea33d800/83444777-5c31-482f-a1f5-fb6cbc8d0848 for MGC192.168.202.124@tcp 00000020:00000080:3.0:1783137967.854457:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137967.854463:0:13157:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.124@tcp (uuid 83444777-5c31-482f-a1f5-fb6cbc8d0848) 00000020:01000000:3.0:1783137967.854468:0:13157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783137967.854470:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137967.854473:0:13157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783137967.854477:0:13157:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e5dfb0d7800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137967.854482:0:13157:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8e5dc7ef4d40) has exports, disconnecting them 00000020:00080000:3.0:1783137967.854485:0:13157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e5dfb0d7800), last request at 1783137740 00000020:00000080:3.0:1783137967.854489:0:13157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6f1e 00000020:00080000:3.0:1783137967.854501:0:13157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e5dfb0d7800): rc 0 00000020:00000080:3.0:1783137967.854504:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dfb0d7800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783137967.854521:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dea33c800 for MGC192.168.202.124@tcp 00000020:00000080:2.0:1783137967.854527:0:36:0:(genops.c:906:class_export_put()) final put ffff8e5dea33b000/83444777-5c31-482f-a1f5-fb6cbc8d0848 00000020:00000080:2.0:1783137967.854529:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dea33b000/83444777-5c31-482f-a1f5-fb6cbc8d0848 for MGC192.168.202.124@tcp 00000020:01000000:2.0:1783137967.854533:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.124@tcp (83444777-5c31-482f-a1f5-fb6cbc8d0848) 00000020:00000080:2.0:1783137967.855371:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfb0d7800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783137967.858688:0:13157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783137967.858704:0:13157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783137967.858708:0:13157:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783137967.858715:0:13157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783137967.858886:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e5dfb0d6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1783137967.859027:0:7510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1783137967.859134:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1783137967.859267:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1783137967.859394:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e5dd1393a00:5796] 1 exiting: rc = 0 00000100:00100000:0.0:1783137967.859488:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e5dd1392c00:5795] 0 exiting: rc = 1 00000100:00100000:2.0:1783137967.859690:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.860238:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e5dd81af000:5799] 2 exiting: rc = 0 00000100:00100000:2.0:1783137967.860317:0:6630:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e5dff986000:6630] 3 exiting: rc = 0 00000100:00100000:2.0:1783137967.860384:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e5dd81af400:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1783137967.860440:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e5dd1393600:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1783137967.860489:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860498:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860505:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860513:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860524:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860745:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860762:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860768:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860775:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860781:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.860786:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861008:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861018:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861024:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861034:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861040:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861050:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861056:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861061:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861066:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861093:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861099:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861104:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861108:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861113:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861118:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861125:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861130:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861134:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861140:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861144:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861149:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861154:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861158:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861162:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861167:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861171:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861175:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861180:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861184:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861189:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861200:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861205:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861211:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861215:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861220:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861224:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861229:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861234:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861239:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861245:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861250:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861256:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861262:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861268:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861273:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861278:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861283:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861288:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861294:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861299:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861304:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861310:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.861320:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783137967.862177:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137967.862187:0:13157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783137967.862193:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5df5964800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783137967.862198:0:13157:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5df5964800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783137967.862203:0:13157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1783137967.862243:0:13157:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dc5c0e000 1 00000020:00000080:2.0:1783137967.862250:0:13157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4691dfc3d66b6ec3 00000020:00000080:2.0:1783137967.862256:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dfa50f800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783137967.862270:0:13157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783137967.862275:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137967.862279:0:13157:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783137967.862288:0:13157:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8e5df5e4cd40) has no exports 00000020:00000080:0.0:1783137967.862404:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dfa50f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783137967.874195:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137967.874212:0:13157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783137967.874218:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dc5c0a800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783137967.874222:0:13157:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc5c0a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783137967.874229:0:13157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783137967.874429:0:13157:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e5dc5c0b800 00000020:01000000:2.0:1783137967.874450:0:13157:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783137967.874454:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137967.874457:0:13157:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783137967.874461:0:13157:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8e5dc7eccd40) has no exports 00000020:00000080:2.0:1783137967.874484:0:13157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137967.874491:0:13157:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783137967.874494:0:13157:0:(genops.c:906:class_export_put()) final put ffff8e5dc44d1000/OSS_uuid 00000020:00000080:2.0:1783137967.874497:0:13157:0:(genops.c:865:class_export_destroy()) destroying export ffff8e5dc44d1000/OSS_uuid for OSS 00000020:01000000:2.0:1783137967.874501:0:13157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783137967.874671:0:6616:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8e5dc574c600:6616] 1 exiting: rc = 0 00000100:00100000:2.0:1783137967.874758:0:6617:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8e5dc574ce00:6617] 2 exiting: rc = 0 00000100:00080000:0.0:1783137967.874880:0:5808:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783137967.875664:0:7801:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8e5dd0be7000:7801] 3 exiting: rc = 0 00000100:00100000:0.0:1783137967.878709:0:6615:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8e5dc93acc00:6615] 0 exiting: rc = 1 00000100:00100000:2.0:1783137967.878989:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879027:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879038:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879045:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879050:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879055:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879061:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879067:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879072:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879076:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879081:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879086:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879091:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879096:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879102:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879111:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879131:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879136:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879142:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879147:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879152:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879158:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879163:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879169:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879174:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879179:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879185:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879190:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879195:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879201:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879206:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879212:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879217:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879222:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879227:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879233:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879238:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879244:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879250:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879255:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879261:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879266:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879271:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879276:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879281:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879287:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879292:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879298:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879303:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879309:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879315:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879327:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879333:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879339:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879345:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879350:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879355:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879360:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879365:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879370:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879375:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879381:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879387:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.879392:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881299:0:6619:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e5df58a9000:6619] 1 exiting: rc = 0 00000100:00100000:2.0:1783137967.881706:0:6618:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e5dc93ac000:6618] 0 exiting: rc = 1 00000100:00100000:0.0:1783137967.881815:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881824:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881830:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881835:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881840:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881845:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881850:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881855:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881860:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881865:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881870:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881874:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881879:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881883:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881888:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881893:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881899:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881904:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881909:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.881914:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882039:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882044:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882049:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882055:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882061:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882066:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882072:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882078:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882083:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882088:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882106:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882111:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882116:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882121:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882125:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882131:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882135:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882140:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882144:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882149:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882155:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882160:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882164:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882169:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882175:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882180:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882185:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882190:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882195:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882200:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882206:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882211:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882215:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882220:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882224:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882229:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882233:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882238:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882243:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882247:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882251:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882255:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882260:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.882273:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137967.883681:0:6621:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e5dc93baa00:6621] 1 exiting: rc = 0 00000100:00100000:1.0:1783137967.883687:0:6620:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e5dc93ba400:6620] 0 exiting: rc = 1 00000100:00100000:0.0:1783137967.884026:0:6622:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e5dc93bb000:6622] 2 exiting: rc = 0 00000100:00100000:0.0:1783137967.884532:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884539:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884660:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884671:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884689:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884708:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884713:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884719:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884724:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884730:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884735:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884741:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884747:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884753:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884759:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884764:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884770:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884775:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884781:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884787:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884855:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884863:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884869:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884875:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884880:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884886:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884892:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884897:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884983:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884992:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.884997:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885002:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885008:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885015:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885021:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885037:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885043:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885048:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885054:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885060:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885066:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885072:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885078:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885083:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885089:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885096:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885101:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885106:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885112:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885117:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885123:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885128:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885134:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885140:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885146:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885152:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885157:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885162:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885169:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885174:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885180:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885185:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885191:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137967.885206:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.891979:0:6624:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e5dc93bba00:6624] 1 exiting: rc = 0 00000100:00100000:3.0:1783137967.892180:0:6623:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e5dc93bac00:6623] 0 exiting: rc = 1 00000100:00100000:1.0:1783137967.892278:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892287:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892292:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892298:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892303:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892308:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892313:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892318:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892323:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892328:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892333:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892351:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892356:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892361:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892366:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892372:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892378:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892383:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892389:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892393:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892398:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892403:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892409:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892414:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892420:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892425:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892431:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892437:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892443:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892449:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892454:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892466:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892473:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892479:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892485:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892490:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892496:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892501:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892507:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892512:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892516:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892522:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892528:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892534:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892539:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892671:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892685:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892692:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892706:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892712:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892717:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892722:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892727:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892732:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892736:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892741:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892746:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892751:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892756:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892761:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892766:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892771:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892775:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.892780:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137967.893955:0:6625:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e5dc93ad800:6625] 0 exiting: rc = 1 00000100:00100000:2.0:1783137967.894147:0:6626:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e5dc93ad600:6626] 1 exiting: rc = 0 00000100:00100000:1.0:1783137967.894213:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894221:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894226:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894234:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894240:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894246:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894253:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894260:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894266:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894271:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894277:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894298:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894307:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894312:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894318:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894324:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894330:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894344:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894350:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894356:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894362:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894368:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894375:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894395:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894402:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894408:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894414:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894420:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894426:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894431:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.894442:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895076:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895087:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895093:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895099:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895120:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895128:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895540:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895562:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895631:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895638:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895642:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895646:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895650:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895654:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895658:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895662:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895676:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895681:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895685:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895689:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895704:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895723:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895731:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895737:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895743:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895748:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895754:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895760:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895780:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895788:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895901:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895909:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137967.895992:0:13157:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783137967.916987:0:13157:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783137986.196679:0:13777:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783137995.244405:0:14189:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783137995.244411:0:14189:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783137995.244845:0:14189:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e5cc26de800 00000020:01000004:3.0:1783137995.244863:0:14189:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783137995.244944:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783137995.244961:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e5dc5dd0000) 00000020:00000080:3.0:1783137995.244975:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783137995.267221:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783137995.269892:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1783137995.270296:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1783137995.270395:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1783137995.270576:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1783137995.270677:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1783137995.270771:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1783137995.270964:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783137995.271041:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1783137995.271301:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1783137995.275244:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 147: rc = 0 00100000:10000000:3.0:1783137995.275350:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 147: rc = 0 00100000:10000000:3.0:1783137995.277184:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:3.0:1783137995.278171:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:3.0:1783137995.278691:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.279047:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.279304:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:3.0:1783137995.280707:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.281773:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:3.0:1783137995.282047:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.282359:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.283094:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:3.0:1783137995.283352:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1783137995.283828:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1783137995.284324:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 795: rc = 0 00100000:10000000:3.0:1783137995.285143:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 795: rc = 0 00100000:10000000:3.0:1783137995.286044:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 795: rc = 0 00100000:10000000:3.0:1783137995.286438:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 795: rc = 0 00100000:10000000:3.0:1783137995.287101:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 795: rc = 0 00100000:10000000:3.0:1783137995.287680:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 795: rc = 0 00100000:10000000:3.0:1783137995.288751:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 795: rc = 0 00100000:10000000:3.0:1783137995.289433:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 795: rc = 0 00100000:10000000:3.0:1783137995.289869:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 795: rc = 0 00100000:10000000:3.0:1783137995.290248:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 795: rc = 0 00100000:10000000:3.0:1783137995.290999:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 795: rc = 0 00100000:10000000:3.0:1783137995.291325:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 795: rc = 0 00100000:10000000:3.0:1783137995.291746:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 795: rc = 0 00100000:10000000:3.0:1783137995.292076:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 795: rc = 0 00100000:10000000:3.0:1783137995.292840:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 795: rc = 0 00100000:10000000:3.0:1783137995.293978:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 795: rc = 0 00100000:10000000:3.0:1783137995.294354:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 795: rc = 0 00100000:10000000:3.0:1783137995.294685:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 795: rc = 0 00100000:10000000:3.0:1783137995.294947:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 795: rc = 0 00100000:10000000:3.0:1783137995.295209:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 795: rc = 0 00100000:10000000:3.0:1783137995.295451:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 795: rc = 0 00100000:10000000:1.0:1783137995.296787:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 795: rc = 0 00100000:10000000:1.0:1783137995.297113:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 795: rc = 0 00100000:10000000:1.0:1783137995.297394:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 795: rc = 0 00100000:10000000:1.0:1783137995.297904:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 795: rc = 0 00100000:10000000:1.0:1783137995.298180:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 795: rc = 0 00100000:10000000:1.0:1783137995.298435:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 795: rc = 0 00100000:10000000:1.0:1783137995.301100:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 795: rc = 0 00100000:10000000:1.0:1783137995.301717:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 795: rc = 0 00100000:10000000:1.0:1783137995.302209:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 795: rc = 0 00100000:10000000:1.0:1783137995.302699:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 795: rc = 0 00100000:10000000:1.0:1783137995.303055:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 795: rc = 0 00100000:10000000:1.0:1783137995.303840:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 560: rc = 0 00100000:10000000:1.0:1783137995.306060:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1783137995.306267:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:1.0:1783137995.306539:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1783137995.307426:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:1.0:1783137995.308027:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1783137995.308109:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:1.0:1783137995.308714:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1783137995.308788:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 148: rc = 0 00100000:10000000:1.0:1783137995.309340:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1783137995.309412:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 148: rc = 0 00100000:10000000:1.0:1783137995.309678:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1783137995.309748:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 148: rc = 0 00000020:00000080:1.0:1783137995.310171:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783137995.310180:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783137995.310192:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b7fe8 00000020:01000004:1.0:1783137995.310202:0:14189:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1783137995.310208:0:14189:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783137995.310214:0:14189:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5cc26de800 from MGS 00000020:01000004:1.0:1783137995.310219:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783137995.310231:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e5df5e4b380) 00000020:00000080:1.0:1783137995.310243:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1783137995.310301:0:14189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5cc26de800 from MGS, refs=2 00080000:01000000:1.0:1783137995.310307:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783137995.310312:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b7ff6 00000100:00100000:1.0:1783137995.310410:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1783137995.310958:0:14189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1783137995.310967:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783137995.313294:0:14189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783137995.313308:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783137995.315023:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137995.315230:0:14189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783137995.315236:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783137995.316413:0:14189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783137995.316424:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783137995.317332:0:14189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783137995.317340:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783137995.318436:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137995.318441:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137995.318443:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137995.319113:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137995.319116:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137995.319118:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137995.320942:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783137995.322187:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783137995.342212:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783137995.342232:0:14189:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137995.342235:0:14189:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783137995.347222:0:14198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783137995.347494:0:14189:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783137995.347867:0:14189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783137995.348403:0:14189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783137995.349148:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137995.349334:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783137995.349341:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783137995.360261:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783137995.360276:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783137995.363445:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783137995.363680:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783137995.368274:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783137995.368304:0:14189:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.124@tcp' 00000020:01000004:1.0:1783137995.368306:0:14189:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783137995.368337:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.124@tcp (typ=mgc) 00000020:00000080:1.0:1783137995.368351:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.124@tcp (ffff8e5df5e499c0) 00000020:00000080:1.0:1783137995.368366:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783137995.368452:0:14189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dfb0d6800@MGC192.168.202.124@tcp: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1783137995.368834:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.124@tcp-0 is initialized 00000040:01000000:1.0:1783137995.368841:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783137995.372266:0:14205:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:3.0:1783137995.376194:0:14203:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1783137995.376775:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.124@tcp (uuid cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe) 00000020:00000080:0.0:1783137995.378459:0:14189:0:(genops.c:1406:class_connect()) connect: client cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe, cookie 0x4691dfc3d66b8004 00000100:00080000:0.0:1783137995.379699:0:14189:0:(import.c:512:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137995.379709:0:14189:0:(import.c:626:import_select_connection()) MGC192.168.202.124@tcp: import ffff8e5dfb0d6800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137995.379749:0:14189:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347ea00 x1869755322559744/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783137995.379814:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3313:1869755322559744:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783137995.380047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783137995.380145:0:14189:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe->MGS 00000020:01000004:0.0:1783137995.380169:0:14189:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783137995.380192:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783137995.380206:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e5dc7ef0000) 00000020:00000080:0.0:1783137995.380220:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783137995.389013:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322559744 00000100:00100000:2.0:1783137995.389030:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322559744 00000100:00100000:2.0:1783137995.389088:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137995.389098:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1869755322559744:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783137995.389128:0:14200:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1783137995.389156:0:14200:0:(genops.c:1406:class_connect()) connect: client cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe, cookie 0x4691dfc3d66b8012 00000100:00080000:2.0:1783137995.389286:0:14200:0:(import.c:65:import_set_state_nolock()) ffff8e5cc19f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137995.389389:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+5:3313:x1869755322559744:12345-0@lo:250:mount.lustre.0 Request processed in 290us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.389407:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137995.391080:0:3313:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783137995.391096:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.124@tcp: connect to target with instance 0 00000100:00080000:0.0:1783137995.391104:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783137995.391110:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783137995.391114:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb0d6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783137995.391118:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783137995.391127:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783137995.391134:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3313:1869755322559744:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783137995.397286:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137995.397695:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783137995.397703:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783137995.401400:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783137995.401415:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783137995.402197:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783137995.402205:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783137995.403800:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137995.404061:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783137995.404067:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783137995.405068:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783137995.405079:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783137995.455958:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137995.456171:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783137995.456179:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783137995.457481:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783137995.457496:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783137995.459104:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137995.459267:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783137995.459273:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783137995.460188:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137995.460196:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783137995.461142:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137995.461301:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137995.461306:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783137995.462147:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137995.462154:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783137995.463133:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137995.463295:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137995.463301:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783137995.464126:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137995.464134:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783137995.486442:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137995.487062:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783137995.487072:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783137995.489494:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783137995.489509:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783137995.490950:0:14189:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783137995.490958:0:14189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783137995.493324:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783137995.493351:0:14189:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783137995.493358:0:14189:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783137995.493516:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783137995.493598:0:14189:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783137995.493603:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783137995.493605:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137995.493607:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137995.493608:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137995.493614:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137995.493615:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137995.493743:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137995.493745:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137995.493747:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137995.493748:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137995.493751:0:14189:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783137995.493753:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783137995.493754:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137995.493755:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137995.493756:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137995.493757:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137995.493758:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137995.493759:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137995.493760:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137995.493761:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137995.493762:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137995.493793:0:14189:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783137995.493816:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322559872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783137995.494020:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137995.494064:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc540cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.494610:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322559872 00000100:00100000:3.0:1783137995.494631:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322559872 00000100:00100000:3.0:1783137995.494683:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137995.494704:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+5:14189:x1869755322559872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783137995.494760:0:14202:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783137995.494763:0:14202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783137995.494766:0:14202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783137995.495243:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783137995.496146:0:14202:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783137995.501068:0:14224:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783137995.501077:0:14224:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783137995.501080:0:14224:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783137995.501112:0:14224:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783137995.501426:0:14202:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783137995.501436:0:14202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783137995.519143:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+5:14189:x1869755322559872:12345-0@lo:253:mount.lustre.0 Request processed in 24429us (25111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.519165:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137995.519280:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322559872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783137995.519298:0:14189:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783137995.519301:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137995.519303:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137995.519304:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137995.519305:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137995.519306:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137995.519308:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137995.519310:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137995.519311:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137995.519314:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137995.519315:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783137995.519338:0:14189:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5cc26de800 from lustre-MDT0000 10000000:01000000:2.0:1783137995.519367:0:14189:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783137995.519371:0:14189:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783137995.519376:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e5df5e499c0 10000000:01000000:2.0:1783137995.519396:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137995.519405:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e5df5e499c0 from 1 10000000:01000000:2.0:1783137995.519408:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783137995.519448:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.519459:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.519751:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137995.519775:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783137995.519817:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137995.519910:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc540cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.520008:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560000 00000100:00100000:3.0:1783137995.520016:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560000 00000100:00100000:3.0:1783137995.520090:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137995.520101:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+5:14189:x1869755322560000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137995.520117:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137995.520133:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b8020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8019 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.520159:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b8020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8019 expref: 6 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.520171:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a7800/0x4691dfc3d66b8020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8019 expref: 6 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.520180:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7800, rc 0) 00000100:00100000:3.0:1783137995.520237:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+6:14189:x1869755322560000:12345-0@lo:101:mount.lustre.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.520244:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137995.520323:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.520337:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.520345:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.520410:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.520436:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.520812:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.521006:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560128 00000100:00100000:2.0:1783137995.521011:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560128 00000100:00100000:2.0:1783137995.521040:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137995.521047:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+6:14189:x1869755322560128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137995.521538:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+6:14189:x1869755322560128:12345-0@lo:501:mount.lustre.0 Request processed in 490us (1099us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137995.521576:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137995.521819:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783137995.521849:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783137995.521867:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.521885:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.521895:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5cc26de800 10000000:01000000:0.0:1783137995.521899:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783137995.521904:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e5cc26de800 10000000:01000000:0.0:1783137995.521907:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783137995.521910:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8e5cc26de800 from 1 10000000:01000000:0.0:1783137995.521913:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783137995.521939:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.521948:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.521957:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.521974:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137995.522012:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.522036:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.522154:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560256 00000100:00100000:2.0:1783137995.522159:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560256 00000100:00100000:2.0:1783137995.522184:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137995.522191:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+6:14189:x1869755322560256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137995.522201:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137995.522214:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3c200/0x4691dfc3d66b802e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8027 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.522247:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3c200/0x4691dfc3d66b802e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8027 expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.522805:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3c200/0x4691dfc3d66b802e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8027 expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.522815:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c200, rc 0) 00000100:00100000:2.0:1783137995.522863:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+7:14189:x1869755322560256:12345-0@lo:101:mount.lustre.0 Request processed in 671us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.523330:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.523347:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b802e expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.523356:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b802e expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.523372:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783137995.523380:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b802e expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.523388:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044c00/0x4691dfc3d66b8027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b802e expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.523395:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783137995.523399:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137995.523404:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e5cc26de800 10000000:01000000:0.0:1783137995.523407:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783137995.523410:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783137995.523412:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783137995.523433:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.523440:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.523448:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137995.523539:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137995.523779:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137995.523820:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.523853:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.524099:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560384 00000100:00100000:2.0:1783137995.524105:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560384 00000100:00100000:2.0:1783137995.524132:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137995.524139:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+7:14189:x1869755322560384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137995.524150:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137995.524162:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3c600/0x4691dfc3d66b803c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8035 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.524180:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3c600/0x4691dfc3d66b803c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8035 expref: 8 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.524190:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3c600/0x4691dfc3d66b803c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8035 expref: 8 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.524198:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c600, rc 0) 00000100:00100000:2.0:1783137995.524782:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+8:14189:x1869755322560384:12345-0@lo:101:mount.lustre.0 Request processed in 640us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.524791:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137995.525073:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.525089:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b803c expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.525099:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b803c expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.525159:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.525189:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.525230:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.525273:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560512 00000100:00100000:2.0:1783137995.525278:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560512 00000100:00100000:2.0:1783137995.525301:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137995.525308:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+8:14189:x1869755322560512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.533249:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14189:x1869755322560512:12345-0@lo:501:mount.lustre.0 Request processed in 7928us (8046us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.533264:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137995.533960:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137995.534022:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137995.534080:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137995.534117:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137995.534322:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560640 00000100:00100000:0.0:1783137995.534330:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560640 00000100:00100000:0.0:1783137995.534382:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137995.534392:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14189:x1869755322560640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137995.538322:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14189:x1869755322560640:12345-0@lo:503:mount.lustre.0 Request processed in 3921us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.538337:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137995.538643:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322560640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137995.539349:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14225:1869755322560768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137995.539410:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137995.539452:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc24123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137995.539567:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322560768 00000100:00100000:0.0:1783137995.539575:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322560768 00000100:00100000:0.0:1783137995.539719:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137995.539730:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14225:x1869755322560768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137995.540034:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14225:x1869755322560768:12345-0@lo:502:llog_process_th.0 Request processed in 305us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.540043:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783137995.540153:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14225:1869755322560768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137995.540183:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137995.540197:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.540199:0:14225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783137995.540207:0:14225:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783137995.540210:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137995.540226:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e5df5c08000) 00000020:00000080:2.0:1783137995.540246:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783137995.540252:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783137995.540338:0:14225:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783137995.540348:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b804a 00000020:00000080:2.0:1783137995.540630:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783137995.540635:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137995.540639:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.540640:0:14225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783137995.540643:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137995.540646:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.540647:0:14225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783137995.540650:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137995.540657:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e5df5c0b380) 00000020:00000080:2.0:1783137995.540667:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783137995.540671:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783137995.540673:0:14225:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783137995.540676:0:14225:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783137995.540682:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783137995.540732:0:14225:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5cc26de800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783137995.540746:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e5df5c099c0) 00000020:00000080:2.0:1783137995.540774:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783137995.540819:0:14225:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783137995.540828:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b805f 00000020:00000080:2.0:1783137995.540964:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783137995.540971:0:14225:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783137995.540976:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4691dfc3d66b8066 00080000:01000000:2.0:1783137995.540982:0:14225:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783137995.540987:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b806d 00010000:00010000:2.0:1783137995.652653:0:14225:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783137995.653111:0:14225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783137995.656888:0:14225:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783137995.657406:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e5df5c0cd40) 00000020:00000080:2.0:1783137995.657428:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783137995.661568:0:14225:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783137995.661587:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b807b 00000020:00000080:2.0:1783137995.667175:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783137995.670416:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4691dfc3d66b8082 00000020:00000080:2.0:1783137995.679899:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783137995.679919:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137995.679933:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.679935:0:14225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783137995.679942:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137995.679949:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.679950:0:14225:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783137995.679955:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783137995.680002:0:14225:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783137995.680022:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137995.680025:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.680027:0:14225:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783137995.680029:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783137995.680031:0:14225:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1783137995.680033:0:14225:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137995.680052:0:14225:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137995.680053:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783137995.680056:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.680057:0:14225:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783137995.680060:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137995.680064:0:14225:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783137995.680067:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.680068:0:14225:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783137995.680071:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783137995.680077:0:14225:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1783137995.680105:0:14225:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783137995.680108:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137995.680128:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e5dc7eccd40) 00000020:00000080:2.0:1783137995.680149:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783137995.680155:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783137995.680209:0:14225:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783137995.680215:0:14225:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783137995.680285:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b8090 00010000:00080000:2.0:1783137995.680319:0:14225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5def043800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1783137995.680855:0:14225:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1783137995.681435:0:14225:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783137995.681499:0:14225:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783137995.686844:0:14225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137995.686930:0:14225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783137995.687008:0:14225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783137995.687726:0:14229:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783137995.687732:0:14229:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783137995.689231:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783137995.689247:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783137995.689281:0:14225:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783137995.689300:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b8097 00000100:00080000:2.0:1783137995.689311:0:14225:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783137995.689323:0:14225:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5def043800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1783137995.689361:0:14225:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df58fa680 x1869755322560896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783137995.689383:0:14225:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783137995.689498:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137995.689502:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.689504:0:14225:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783137995.689506:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783137995.689509:0:14225:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1783137995.689511:0:14225:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137995.689513:0:14225:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137995.689514:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783137995.689516:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.689518:0:14225:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783137995.689520:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137995.689523:0:14225:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783137995.689526:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.689527:0:14225:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783137995.689530:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783137995.689533:0:14225:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1783137995.689585:0:14225:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783137995.689588:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137995.689598:0:14225:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e5dc7ec8000) 00000020:00000080:2.0:1783137995.689609:0:14225:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783137995.689620:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783137995.689680:0:14225:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783137995.689685:0:14225:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783137995.689697:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4691dfc3d66b80a5 00010000:00080000:2.0:1783137995.689725:0:14225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dc5dc2800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1783137995.689931:0:14225:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783137995.690126:0:14225:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783137995.690152:0:14225:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783137995.690696:0:14225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137995.690760:0:14225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783137995.690820:0:14225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1783137995.691611:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322560896:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783137995.691688:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755322560896 offset 0 length 520: 4 00000040:00080000:3.0:1783137995.692307:0:14231:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783137995.692313:0:14231:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783137995.692976:0:14225:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783137995.692989:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783137995.693024:0:14225:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783137995.693044:0:14225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b80ac 00000100:00080000:0.0:1783137995.693054:0:14225:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137995.693061:0:14225:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783137995.693097:0:14225:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347ce00 x1869755322561024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783137995.693131:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322561024:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783137995.693174:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755322561024 offset 0 length 520: 4 00000100:00080000:0.0:1783137995.693237:0:14225:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783137995.695773:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137995.695784:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137995.695786:0:14225:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783137995.695790:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137995.695794:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137995.695796:0:14225:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783137995.695798:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783137995.695800:0:14225:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783137995.695802:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137995.695817:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137995.695819:0:14225:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783137995.695822:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137995.695825:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137995.695826:0:14225:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137995.695830:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783137995.695882:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14225:1869755322561152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137995.695967:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.696008:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.696081:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561152 00000100:00100000:3.0:1783137995.696094:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561152 00000100:00100000:3.0:1783137995.696180:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137995.696190:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14225:x1869755322561152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.696480:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14225:x1869755322561152:12345-0@lo:502:llog_process_th.0 Request processed in 290us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.696488:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137995.696987:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14225:1869755322561152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137995.697017:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137995.697022:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137995.697024:0:14225:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783137995.697027:0:14225:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783137995.697155:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1783137995.697180:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783137995.697205:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b803c expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.697215:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045a00/0x4691dfc3d66b8035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b803c expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.697334:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5cc26de800 from 1 10000000:01000000:0.0:1783137995.697337:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783137995.697366:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.697375:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.697384:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.697399:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137995.697431:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.697482:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.698038:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561280 00000100:00100000:2.0:1783137995.698044:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561280 00000100:00100000:2.0:1783137995.698170:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137995.698181:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+9:14189:x1869755322561280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137995.698196:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137995.698212:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b80b3 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.698234:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 10 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.698246:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 10 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.698254:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3ce00, rc 0) 00000100:00100000:2.0:1783137995.698298:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+10:14189:x1869755322561280:12345-0@lo:101:mount.lustre.0 Request processed in 119us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.698305:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137995.698339:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.698353:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.698361:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.698956:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561408:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783137995.699002:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.699041:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137995.699435:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561408 00000100:00100000:1.0:1783137995.699441:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561408 00000100:00100000:1.0:1783137995.699600:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783137995.699610:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+10:14189:x1869755322561408:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783137995.699858:0:14201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783137995.699864:0:14201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783137995.700222:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+10:14189:x1869755322561408:12345-0@lo:256:mount.lustre.0 Request processed in 611us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137995.700231:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137995.700422:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561408:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783137995.702456:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783137995.702502:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.702516:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.702527:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5cc26de800 from 1 10000000:01000000:0.0:1783137995.702529:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137995.702604:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.702620:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.702631:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.702676:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137995.704249:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.704297:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.704756:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561536 00000100:00100000:2.0:1783137995.704766:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561536 00000100:00100000:2.0:1783137995.704819:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783137995.704841:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+10:14189:x1869755322561536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137995.704861:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137995.705342:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b80c1 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.705376:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.705387:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137995.705396:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d000, rc 0) 00000100:00100000:2.0:1783137995.705521:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322561536:12345-0@lo:101:mount.lustre.0 Request processed in 681us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.705530:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137995.706310:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.706332:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.706344:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.706417:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.706453:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.706508:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137995.706519:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561664 00000100:00100000:1.0:1783137995.706525:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561664 00000100:00100000:1.0:1783137995.706581:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137995.706590:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322561664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137995.707033:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322561664:12345-0@lo:501:mount.lustre.0 Request processed in 444us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137995.707041:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137995.707133:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.707168:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137995.707209:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.707244:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.707291:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561792 00000100:00100000:3.0:1783137995.707295:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561792 00000100:00100000:3.0:1783137995.707320:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137995.707325:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322561792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137995.707441:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322561792:12345-0@lo:503:mount.lustre.0 Request processed in 115us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.707448:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783137995.707538:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322561792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137995.708542:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14233:1869755322561920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.708844:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137995.708882:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322561920 00000100:00100000:1.0:1783137995.708889:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322561920 00000100:00100000:1.0:1783137995.708931:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783137995.708940:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14233:x1869755322561920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.708992:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb098e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.709201:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14233:1869755322561920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137995.709231:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137995.709242:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137995.709245:0:14233:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783137995.709252:0:14233:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5cc26de800 00000020:00000080:3.0:1783137995.709254:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137995.709262:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137995.709264:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1783137995.709264:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14233:x1869755322561920:12345-0@lo:502:llog_process_th.0 Request processed in 324us (419us total) trans 0 rc 0/0 00000020:00000080:3.0:1783137995.709266:0:14233:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783137995.709268:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137995.709270:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137995.709271:0:14233:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000100:00100000:1.0:1783137995.709272:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:3.0:1783137995.709280:0:14233:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5cc26de800 00000020:00000080:3.0:1783137995.709282:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137995.709336:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137995.709339:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137995.709341:0:14233:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783137995.709343:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137995.709346:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137995.709347:0:14233:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783137995.709350:0:14233:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5cc26de800 00000020:00000080:3.0:1783137995.709352:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783137995.709387:0:14233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14233:1869755322562048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.709418:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137995.709446:0:14233:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfb098e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137995.709503:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562048 00000100:00100000:2.0:1783137995.709507:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562048 00000100:00100000:2.0:1783137995.709611:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783137995.709630:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14233:x1869755322562048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137995.709769:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14233:x1869755322562048:12345-0@lo:502:llog_process_th.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.709777:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137995.709843:0:14233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14233:1869755322562048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137995.709860:0:14233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137995.709864:0:14233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137995.709866:0:14233:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783137995.709881:0:14233:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783137995.711929:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783137995.711971:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137995.711992:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.712006:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137995.712144:0:14189:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783137995.712148:0:14189:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5cc26de800 10000000:01000000:0.0:1783137995.712151:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5cc26de800 10000000:01000000:0.0:1783137995.712156:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137995.712162:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5cc26de800 from 1 10000000:01000000:0.0:1783137995.712165:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137995.712201:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.712210:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.712220:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.712245:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137995.713184:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.713235:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137995.713754:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562176 00000100:00100000:1.0:1783137995.713765:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562176 00000100:00100000:1.0:1783137995.713821:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783137995.713831:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322562176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137995.713850:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137995.713870:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b80d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b80cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.713899:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b80d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b80cf expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.713911:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6c600/0x4691dfc3d66b80d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80cf expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.713918:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c600, rc 0) 00000100:00100000:1.0:1783137995.713969:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562176:12345-0@lo:101:mount.lustre.0 Request processed in 139us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137995.713975:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137995.714606:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137995.714764:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80d6 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.714775:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b80d6 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137995.714847:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.714888:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.714933:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.715284:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562304 00000100:00100000:3.0:1783137995.715290:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562304 00000100:00100000:3.0:1783137995.715322:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137995.715330:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137995.716265:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562304:12345-0@lo:501:mount.lustre.0 Request processed in 931us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.716277:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137995.716759:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137995.716814:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137995.716859:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.716906:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.717589:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562432 00000100:00100000:3.0:1783137995.717598:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562432 00000100:00100000:3.0:1783137995.717775:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137995.717784:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137995.718000:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562432:12345-0@lo:503:mount.lustre.0 Request processed in 216us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.718008:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783137995.718191:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137995.719312:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14237:1869755322562560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.719365:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137995.719407:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd206f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137995.719816:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562560 00000100:00100000:0.0:1783137995.719823:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562560 00000100:00100000:0.0:1783137995.719865:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137995.719886:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14237:x1869755322562560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137995.721823:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14237:1869755322562560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137995.722155:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14237:x1869755322562560:12345-0@lo:502:llog_process_th.0 Request processed in 1577us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137995.722169:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:01000004:3.0:1783137995.722401:0:14237:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783137995.722417:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e5dc5dd3380) 00000020:00000080:3.0:1783137995.722436:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1783137995.722918:0:14237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5cc26de800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783137995.722923:0:14237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5cc26de800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783137995.722926:0:14237:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5cc26de800 4 00010000:00080000:3.0:1783137995.722957:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dc6680800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1783137995.732423:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1783137995.732585:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783137995.732638:0:14237:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783137995.732654:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4691dfc3d66b80e4 00000100:00080000:1.0:1783137995.732669:0:14237:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137995.732679:0:14237:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5dc6680800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783137995.732722:0:14237:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5dffe38700 x1869755322562688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137995.732785:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322562688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783137995.732876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783137995.732947:0:14237:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783137995.733941:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14237:1869755322562816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137995.734005:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137995.734040:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562816 00000100:00100000:1.0:1783137995.734047:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562816 00000100:00100000:1.0:1783137995.734095:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137995.734104:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14237:x1869755322562816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137995.734343:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14237:x1869755322562816:12345-0@lo:502:llog_process_th.0 Request processed in 239us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137995.734351:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137995.734397:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137995.734422:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14237:1869755322562816:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783137995.734450:0:14237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1783137995.734849:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562688 00000100:00100000:3.0:1783137995.734854:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562688 00000100:00100000:3.0:1783137995.734884:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137995.734889:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322562688:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783137995.734940:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322562688:12345-0@lo:38:llog_process_th.0 Request processed in 50us (2064us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783137995.734948:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137995.734972:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783137995.734979:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc6680800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783137995.734985:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783137995.734988:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322562688:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1783137995.735124:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783137995.735144:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137995.735160:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80d6 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137995.735168:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045200/0x4691dfc3d66b80cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80d6 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137995.735210:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783137995.735211:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137995.735212:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137995.735213:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137995.735214:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137995.735215:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137995.735216:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137995.735217:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137995.735221:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137995.735222:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137995.735224:0:14189:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783137995.735226:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137995.735227:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137995.735228:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137995.735228:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137995.735229:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137995.735229:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137995.735230:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137995.735231:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137995.735231:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137995.735232:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137995.735245:0:14189:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783137995.735539:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783137995.735856:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137995.736110:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137995.740151:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322562944 00000100:00100000:3.0:1783137995.740166:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322562944 00000100:00100000:3.0:1783137995.740230:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783137995.740241:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14189:x1869755322562944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783137995.740308:0:14200:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783137995.740326:0:14200:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783137995.787432:0:14200:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783137995.787451:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783137995.787852:0:14223:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783137995.787858:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783137995.787890:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.787911:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.787934:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.787983:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.787998:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 12 pid: 14200 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137995.788014:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322563072:0@lo:104: 00000100:00100000:1.0:1783137995.788093:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137995.788143:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd12ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137995.788182:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563072 00000100:00100000:1.0:1783137995.788189:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563072 00000100:00100000:1.0:1783137995.788236:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137995.788245:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322563072:12345-0@lo:104: 00010000:00010000:1.0:1783137995.788258:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.788317:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137995.788325:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322563072:12345-0@lo:104: Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137995.788338:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783137995.788339:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137995.788354:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788366:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:3.0:1783137995.788371:0:14196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788384:0:14196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137995.788386:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322563072:0@lo:104: 10000000:00010000:3.0:1783137995.788407:0:14196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137995.788414:0:14196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783137995.788416:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788478:0:14196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788488:0:14196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137995.788687:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788697:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044400/0x4691dfc3d66b80b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80ba expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.788726:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137995.788728:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137995.788730:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137995.788777:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137995.788808:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322563200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137995.789727:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137995.789835:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563200 00000100:00100000:3.0:1783137995.789846:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563200 00010000:00010000:3.0:1783137995.789884:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 13 pid: 14200 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137995.789927:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137995.789936:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+13:3317:x1869755322563200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137995.789953:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137995.789961:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 13 pid: 14200 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.789975:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 13 pid: 14200 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790006:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b80ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b80b3 expref: 13 pid: 14200 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790026:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790036:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783137995.790056:0:14192:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002198167s 00010000:00010000:3.0:1783137995.790062:0:14192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790069:0:14192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790092:0:14192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790100:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790108:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783137995.790113:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790121:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790139:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137995.790151:0:14223:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137995.790152:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137995.790183:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137995.790204:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3317:x1869755322563200:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.790214:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137995.790260:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322563200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137995.790311:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6d000/0x4691dfc3d66b80eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137995.807262:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14189:x1869755322562944:12345-0@lo:253:mount.lustre.0 Request processed in 67005us (71390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.807281:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137995.807299:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14189:1869755322562944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783137995.807322:0:14189:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783137995.807327:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137995.807329:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137995.807330:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137995.807332:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137995.807334:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137995.807336:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137995.807338:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137995.807340:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137995.807342:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137995.807344:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137995.807365:0:14189:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783137995.817374:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.817727:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137995.817996:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.819597:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137995.819943:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.820055:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137995.824753:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.824940:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137995.825157:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.825324:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137995.825594:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137995.825762:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1783137995.866506:0:14189:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783137995.867306:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783137995.867643:0:14247:0:(llog_osd.c:2247:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1783137995.867735:0:14247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137995.869840:0:14247:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783137995.869932:0:14247:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783137995.869947:0:14247:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1783137995.872636:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783137995.872785:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783137995.873210:0:14189:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783137995.873219:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783137995.873352:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1783137995.875106:0:14246:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783137995.875116:0:14246:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1783137995.876959:0:14189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783137995.878202:0:14189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783137995.878267:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1783137995.883397:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1783137995.893081:0:14189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783137995.947650:0:14189:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783137995.947711:0:14189:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab14c1c53988 00100000:10000000:2.0:1783137995.947720:0:14189:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783137995.948985:0:14189:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783137995.949000:0:14189:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783137995.949015:0:14189:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783137995.949043:0:14189:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783137996.347494:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137996.747970:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1783137996.801265:0:14205:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783137996.801275:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5cc26de800 from 6 10000000:01000000:0.0:1783137996.801280:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783137996.801331:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137996.801355:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137996.801380:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137996.801411:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322563328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137996.801502:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137996.801594:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137996.801606:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563328 00000100:00100000:1.0:1783137996.801614:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563328 00000100:00100000:1.0:1783137996.801685:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783137996.801797:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14205:x1869755322563328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137996.801813:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137996.801836:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b80f2 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137996.801859:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137996.801870:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137996.801886:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d600, rc 0) 00000100:00100000:1.0:1783137996.801925:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322563328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137996.801931:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137996.802501:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322563328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137996.802518:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137996.802527:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137996.802606:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322563456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783137996.802639:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137996.802668:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137996.803410:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563456 00000100:00100000:1.0:1783137996.803417:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563456 00000100:00100000:1.0:1783137996.803472:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137996.803482:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322563456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783137996.803504:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137996.803521:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137996.803525:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783137996.803649:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322563456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137996.803658:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783137996.803818:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322563456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783137996.803870:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783137996.803879:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137996.803889:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137997.370872:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137997.755208:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783137998.395272:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137999.422188:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138000.447762:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138001.086035:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138001.086043:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138001.086047:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138001.086050:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138001.086053:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783138001.086056:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783138001.086061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5dc6680800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138001.086075:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e5dc6680800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783138001.086102:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5cc8e00 x1869755322563712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138001.086140:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322563584:0@lo:400:kworker.0 00000100:00100000:3.0:1783138001.086231:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138001.086310:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563584 00000100:00100000:3.0:1783138001.086319:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563584 00000100:00100000:3.0:1783138001.086405:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783138001.086415:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3317:x1869755322563584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138001.086487:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3317:x1869755322563584:12345-0@lo:400:kworker.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138001.086494:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783138001.086572:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322563584:0@lo:400:kworker.0 00000100:00100000:2.0:1783138001.086705:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322563712:0@lo:38:kworker.0 00000100:00100000:2.0:1783138001.086768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138001.087726:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563712 00000100:00100000:3.0:1783138001.087740:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563712 00000100:00100000:3.0:1783138001.087782:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138001.087788:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869755322563712:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783138001.087813:0:14209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1783138001.088995:0:14209:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4691dfc3d66b8100 00000004:00100000:1.0:1783138001.092865:0:14209:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783138001.093078:0:14209:0:(import.c:65:import_set_state_nolock()) ffff8e5de0d49800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138001.093208:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869755322563712:12345-0@lo:38:kworker.0 Request processed in 5415us (6435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138001.093228:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783138001.094138:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df5cc8e00 x1869755322563712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783138001.094161:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783138001.094175:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783138001.094183:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783138001.094194:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc6680800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138001.094204:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869755322563712:0@lo:38:kworker.0 00010000:00010000:3.0:1783138001.471933:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138002.011194:0:14490:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783138002.509465:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138003.517699:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138004.538759:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138005.194725:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137995/real 1783137995] req@ffff8e5cc347ce00 x1869755322561024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138005.194768:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5cc347ce00 x1869755322561024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138005.194781:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137995/real 1783137995] req@ffff8e5df58fa680 x1869755322560896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138005.194793:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5df58fa680 x1869755322560896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783138005.194826:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138005.194849:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783138005.194854:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322561024:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783138005.194862:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5def043800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138005.194867:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783138005.194872:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322560896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783138005.195299:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138005.195304:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138005.195307:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5def043800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138005.195314:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:0.0:1783138005.195320:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138005.195328:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5def043800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783138005.195350:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347f480 x1869755322563968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138005.195363:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138005.195366:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138005.195368:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138005.195370:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:0.0:1783138005.195373:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138005.195376:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783138005.195386:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347e680 x1869755322564096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138005.195463:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322564224:0@lo:400:kworker.0 00000100:00100000:0.0:1783138005.195587:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138005.195657:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138005.195664:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322563840:0@lo:400:kworker.0 00000100:00100000:0.0:1783138005.195698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138005.195739:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322563840 00000100:00100000:0.0:1783138005.195759:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322563840 00000100:00100000:0.0:1783138005.195808:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783138005.195819:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3315:x1869755322563840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138005.195878:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3315:x1869755322563840:12345-0@lo:400:kworker.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138005.195886:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783138005.195920:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322563968:0@lo:8:kworker.0 00000400:00000100:0.0:1783138005.195941:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755322563968 offset 0 length 520: 4 00000100:00100000:0.0:1783138005.195953:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322564096:0@lo:8:kworker.0 00000400:00000100:0.0:1783138005.195967:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755322564096 offset 0 length 520: 4 00000100:00100000:0.0:1783138005.196003:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322563840:0@lo:400:kworker.0 00000100:00100000:3.0:1783138005.196136:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564224 00000100:00100000:3.0:1783138005.196140:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564224 00000100:00100000:3.0:1783138005.196184:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138005.196192:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322564224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138005.196240:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322564224:12345-0@lo:400:kworker.0 Request processed in 49us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138005.196246:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783138005.196286:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5cc347f800 x1869755322564224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138005.196300:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322564224:0@lo:400:kworker.0 00010000:00010000:1.0:1783138005.565087:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783138006.061922:0:14640:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4fd11bd0 20000000:00000080:1.0:1783138006.061941:0:14640:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5e01add800 uarg=0000000000000000 20000000:01000000:1.0:1783138006.062051:0:14640:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783138006.062059:0:14640:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783138006.062064:0:14640:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783138006.063181:0:14641:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1783138006.063438:0:14640:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783138006.071525:0:14640:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783138006.071605:0:14640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.071624:0:14640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.071633:0:14640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.073833:0:14640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.073856:0:14640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138006.073873:0:14640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14640:1869755322564352:0@lo:104: 00000100:00100000:1.0:1783138006.073941:0:14640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138006.074168:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564352 00000100:00100000:3.0:1783138006.074176:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564352 00000100:00100000:3.0:1783138006.074230:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138006.074239:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14640:x1869755322564352:12345-0@lo:104: 00010000:00010000:3.0:1783138006.074252:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074310:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783138006.074316:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14640:x1869755322564352:12345-0@lo:104: Request processed in 79us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138006.074340:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783138006.074366:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138006.074372:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074379:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045400 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:3.0:1783138006.074392:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074402:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138006.074409:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138006.074416:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783138006.074448:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074454:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138006.074476:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074496:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045400/0x4691dfc3d66b80c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80c8 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138006.074517:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138006.074519:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138006.074520:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138006.074569:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322564480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138006.074606:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138006.075229:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564480 00000100:00100000:0.0:1783138006.075235:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564480 00010000:00010000:0.0:1783138006.075259:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 12 pid: 14200 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138006.075298:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138006.075305:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3316:x1869755322564480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138006.075316:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138006.075321:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 12 pid: 14200 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075331:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 12 pid: 14200 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075348:0:14193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075370:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075395:0:14193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075403:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075408:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075414:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075420:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138006.075424:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075431:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075440:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138006.075451:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138006.075499:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3316:x1869755322564480:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138006.075506:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138006.076003:0:14640:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429240 going to sleep for 11 seconds 00010000:00010000:1.0:1783138006.076030:0:14640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5df5e3d000/0x4691dfc3d66b80c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b80c1 expref: 11 pid: 14200 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138006.076044:0:14640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14640:1869755322564352:0@lo:104: 00010000:00010000:1.0:1783138006.076065:0:14640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.076075:0:14640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.076081:0:14640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138006.076095:0:14640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6d800/0x4691dfc3d66b8107 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138006.077473:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322564480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138006.587886:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783138007.098661:0:14205:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783138007.098695:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5cc26de800 from 10 10000000:01000000:0.0:1783138007.098702:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138007.098768:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138007.098784:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138007.098797:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138007.098830:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783138007.098924:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138007.098996:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc11ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138007.099288:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564608 00000100:00100000:3.0:1783138007.099298:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564608 00000100:00100000:3.0:1783138007.099381:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138007.099393:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+11:14205:x1869755322564608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138007.099412:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138007.099433:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b810e expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138007.099680:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138007.099694:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138007.099705:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783138007.099900:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322564608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 509us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138007.099908:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783138007.119601:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138007.119644:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138007.119673:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138007.122018:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138007.122130:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138007.122195:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc11ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1783138007.122330:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564736 00000100:00100000:1.0:1783138007.122338:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564736 00000100:00100000:1.0:1783138007.122407:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783138007.122419:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322564736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138007.122813:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322564736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138007.122822:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783138007.123167:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138007.123229:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138007.123295:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138007.123349:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc11ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1783138007.124659:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564864 00000100:00100000:1.0:1783138007.124675:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564864 00000100:00100000:1.0:1783138007.124739:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783138007.124750:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322564864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138007.125120:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14205:x1869755322564864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 371us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138007.125129:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138007.125627:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322564864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783138007.144203:0:14666:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783138007.150449:0:14205:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783138007.150503:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138007.150519:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138007.150534:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138007.610821:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783138007.995315:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783138008.636687:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138009.660442:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138010.300917:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322564992:0@lo:400:kworker.0 00000100:00100000:3.0:1783138010.301026:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138010.301137:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322564992 00000100:00100000:0.0:1783138010.301148:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322564992 00000100:00100000:0.0:1783138010.301216:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783138010.301229:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3317:x1869755322564992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783138010.301404:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138010.301410:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138010.301414:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138010.301417:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783138010.304628:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322565120:0@lo:400:kworker.0 00000100:00100000:1.0:1783138010.304735:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138010.304822:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565120 00000100:00100000:1.0:1783138010.304831:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565120 00000100:00100000:1.0:1783138010.304897:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138010.304908:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322565120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138010.304973:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322565120:12345-0@lo:400:kworker.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138010.304981:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783138010.305031:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df58f8700 x1869755322565120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138010.305050:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322565120:0@lo:400:kworker.0 00000100:00100000:0.0:1783138010.306692:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:3317:x1869755322564992:12345-0@lo:400:kworker.0 Request processed in 5452us (5653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138010.306717:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783138010.308704:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322564992:0@lo:400:kworker.0 00010000:00010000:2.0:1783138010.682830:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138011.200672:0:14842:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783138011.200676:0:14842:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783138011.200829:0:14842:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e5dd0bfe000 00000020:01000004:3.0:1783138011.200846:0:14842:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783138011.200860:0:14842:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783138011.200874:0:14842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e5dc5dd19c0) 00000020:00000080:3.0:1783138011.200891:0:14842:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783138011.231510:0:14842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783138011.231905:0:14842:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783138011.236299:0:14842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783138011.236866:0:14842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783138011.237111:0:14842:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783138011.238063:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 689: rc = 0 00100000:10000000:2.0:1783138011.238317:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 689: rc = 0 00100000:10000000:2.0:1783138011.238848:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 689: rc = 0 00100000:10000000:2.0:1783138011.240059:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 314: rc = 0 00100000:10000000:2.0:1783138011.240748:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 314: rc = 0 00100000:10000000:2.0:1783138011.241934:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 314: rc = 0 00100000:10000000:2.0:1783138011.242936:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 314: rc = 0 00100000:10000000:2.0:1783138011.243833:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 314: rc = 0 00100000:10000000:2.0:1783138011.244124:0:14842:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 314: rc = 0 00000020:00000080:2.0:1783138011.245398:0:14842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783138011.245410:0:14842:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783138011.245423:0:14842:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4691dfc3d66b8123 00000020:01000004:2.0:1783138011.245432:0:14842:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783138011.245734:0:14842:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783138011.245739:0:14842:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783138011.245746:0:14842:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783138011.245758:0:14842:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783138011.245771:0:14842:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e5dc7ecb380) 00000020:00000080:2.0:1783138011.245784:0:14842:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783138011.247503:0:14842:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138011.251005:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783138011.251018:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783138011.252706:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783138011.252721:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783138011.255721:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783138011.255734:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783138011.257887:0:14842:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138011.258191:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783138011.258198:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783138011.258838:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783138011.258845:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783138011.276724:0:14842:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138011.276965:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783138011.276975:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783138011.280446:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783138011.280464:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783138011.283615:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783138011.283629:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783138011.288995:0:14842:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138011.289200:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783138011.289207:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783138011.290214:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783138011.290222:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783138011.347958:0:14842:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138011.348162:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783138011.348169:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783138011.349660:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783138011.349669:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783138011.350059:0:14842:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783138011.350082:0:14842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1783138011.350089:0:14842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783138011.380224:0:14842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783138011.380264:0:14842:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783138011.380269:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783138011.380272:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138011.380273:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138011.380275:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138011.380276:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138011.380277:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138011.380279:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138011.380280:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138011.380282:0:14842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138011.380286:0:14842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783138011.380288:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138011.380289:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138011.380290:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138011.380292:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138011.380293:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138011.380294:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138011.380295:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138011.380296:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138011.380297:0:14842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138011.380721:0:14842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783138011.380748:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138011.380839:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.380976:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.381094:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565248 00000100:00100000:1.0:1783138011.381103:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565248 00000100:00100000:1.0:1783138011.381213:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783138011.381224:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14842:x1869755322565248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783138011.381260:0:14201:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783138011.381263:0:14201:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783138011.381267:0:14201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783138011.394201:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14842:x1869755322565248:12345-0@lo:253:mount.lustre.0 Request processed in 12970us (13352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.394217:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138011.394530:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783138011.394680:0:14842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783138011.394684:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138011.394687:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138011.394688:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138011.394689:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138011.394691:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138011.394692:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138011.394694:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138011.394696:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138011.394698:0:14842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783138011.394722:0:14842:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5dd0bfe000 from lustre-OST0000 10000000:01000000:2.0:1783138011.394750:0:14842:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783138011.394753:0:14842:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783138011.394760:0:14842:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5df5e499c0 local copy 00010000:00010000:2.0:1783138011.394772:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.395119:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138011.395166:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.395259:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.395723:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565376 00000100:00100000:0.0:1783138011.395732:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565376 00000100:00100000:0.0:1783138011.395830:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783138011.395841:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14842:x1869755322565376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138011.396065:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14842:x1869755322565376:12345-0@lo:501:mount.lustre.0 Request processed in 224us (897us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783138011.396074:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783138011.396166:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783138011.396185:0:14842:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783138011.396372:0:14842:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783138011.396380:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.396390:0:14842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138011.396411:0:14842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5dd0bfe000 10000000:01000000:2.0:1783138011.396422:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783138011.396429:0:14842:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e5df5e499c0 10000000:01000000:2.0:1783138011.396431:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783138011.396445:0:14842:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8e5df5e499c0 from 1 10000000:01000000:2.0:1783138011.396449:0:14842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783138011.396481:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.396490:0:14842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.396499:0:14842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.396515:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138011.396570:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.397258:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138011.397304:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565504 00000100:00100000:3.0:1783138011.397327:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565504 00000100:00100000:0.0:1783138011.397849:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783138011.397864:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+12:14842:x1869755322565504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138011.397881:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138011.399049:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02044200/0x4691dfc3d66b8138 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8131 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.399101:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044200/0x4691dfc3d66b8138 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8131 expref: 13 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.399113:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02044200/0x4691dfc3d66b8138 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8131 expref: 13 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.399122:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044200, rc 0) 00000100:00100000:0.0:1783138011.399196:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+13:14842:x1869755322565504:12345-0@lo:101:mount.lustre.0 Request processed in 1336us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.399205:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783138011.399323:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138011.399354:0:14842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8138 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.399364:0:14842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8138 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138011.399389:0:14842:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783138011.399404:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8138 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.399412:0:14842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3d000/0x4691dfc3d66b8131 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8138 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138011.399444:0:14842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783138011.399449:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783138011.399456:0:14842:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783138011.399459:0:14842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783138011.399487:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.399494:0:14842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.399503:0:14842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.399522:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138011.399577:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.400121:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc2e529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.400326:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565632 00000100:00100000:1.0:1783138011.400334:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565632 00000100:00100000:1.0:1783138011.400397:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138011.400418:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+13:14842:x1869755322565632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138011.400541:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138011.400586:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6c200/0x4691dfc3d66b8146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b813f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.400621:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6c200/0x4691dfc3d66b8146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b813f expref: 14 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.400631:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6c200/0x4691dfc3d66b8146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b813f expref: 14 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.400639:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c200, rc 0) 00000100:00100000:1.0:1783138011.400682:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322565632:12345-0@lo:101:mount.lustre.0 Request processed in 266us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.400689:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138011.400866:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138011.400881:0:14842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8146 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.400890:0:14842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8146 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138011.402277:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783138011.404150:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138011.404691:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783138011.404749:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783138011.404785:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783138011.404838:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783138011.404876:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783138011.404988:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783138011.405079:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783138011.405089:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783138011.405181:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138011.405268:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.405324:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.405704:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565760 00000100:00100000:1.0:1783138011.405714:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565760 00000100:00100000:1.0:1783138011.405770:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783138011.405781:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322565760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138011.406248:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322565760:12345-0@lo:501:mount.lustre.0 Request processed in 467us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.406257:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783138011.406732:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138011.406788:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138011.406839:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138011.406867:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd85e7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.406999:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322565888 00000100:00100000:1.0:1783138011.407004:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322565888 00000100:00100000:1.0:1783138011.407046:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138011.407055:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322565888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138011.407540:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322565888:12345-0@lo:503:mount.lustre.0 Request processed in 484us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.407573:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138011.407869:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322565888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138011.408798:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138011.408886:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138011.409041:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.409326:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.409731:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566016 00000100:00100000:1.0:1783138011.409740:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566016 00000100:00100000:1.0:1783138011.409822:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138011.409832:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322566016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138011.410176:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322566016:12345-0@lo:502:mount.lustre.0 Request processed in 344us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.410184:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783138011.410270:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138011.410773:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783138011.410833:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783138011.410883:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783138011.411020:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783138011.411059:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783138011.411095:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783138011.411144:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783138011.411182:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783138011.411217:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783138011.411265:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783138011.411304:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783138011.411368:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783138011.411413:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138011.411846:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.412088:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.412162:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566144 00000100:00100000:0.0:1783138011.412170:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566144 00000100:00100000:0.0:1783138011.412207:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138011.412216:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322566144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138011.412451:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322566144:12345-0@lo:502:mount.lustre.0 Request processed in 235us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.412459:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783138011.412650:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138011.412736:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783138011.412748:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1783138011.413889:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783138011.413911:0:14856:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1783138011.413927:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138011.413929:0:14856:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783138011.413937:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783138011.413952:0:14856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e5dc5dd4d40) 00000020:00000080:3.0:1783138011.413973:0:14856:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783138011.413979:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783138011.414054:0:14856:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dd0bfe000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783138011.414061:0:14856:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783138011.414069:0:14856:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4691dfc3d66b8154 00010000:00010000:3.0:1783138011.420114:0:14856:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1783138011.420715:0:14856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1783138011.423151:0:14856:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783138011.425013:0:14856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783138011.425024:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.425032:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425034:0:14856:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783138011.425038:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783138011.425048:0:14856:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1783138011.425049:0:14856:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138011.425051:0:14856:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138011.425053:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783138011.425056:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425057:0:14856:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783138011.425060:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138011.425063:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425064:0:14856:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783138011.425067:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783138011.425069:0:14856:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783138011.425071:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.425073:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425074:0:14856:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783138011.425077:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138011.425079:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425080:0:14856:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783138011.425083:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783138011.425143:0:14856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.425148:0:14856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.425149:0:14856:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783138011.425153:0:14856:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1783138011.425300:0:14842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783138011.425325:0:14842:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783138011.425358:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8146 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.425371:0:14842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c000/0x4691dfc3d66b813f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8146 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138011.425379:0:14842:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd0bfe000 from 1 10000000:01000000:3.0:1783138011.425382:0:14842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783138011.425419:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.425428:0:14842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.425451:0:14842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138011.425478:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138011.425582:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.425745:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.425813:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566272 00000100:00100000:0.0:1783138011.425822:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566272 00000100:00100000:0.0:1783138011.425872:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783138011.425882:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+14:14842:x1869755322566272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138011.425897:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138011.425921:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b815b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.425943:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 15 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.425953:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 15 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.425970:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045400, rc 0) 00000100:00100000:0.0:1783138011.426012:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566272:12345-0@lo:101:mount.lustre.0 Request processed in 131us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.426018:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138011.426164:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138011.426180:0:14842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.426199:0:14842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138011.426891:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783138011.427266:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138011.428050:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783138011.428107:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783138011.428189:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783138011.428198:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783138011.429857:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138011.430014:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.430120:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.439677:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566400 00000100:00100000:1.0:1783138011.439695:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566400 00000100:00100000:1.0:1783138011.439763:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783138011.439774:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138011.440814:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566400:12345-0@lo:501:mount.lustre.0 Request processed in 1037us (10796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.440825:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783138011.441524:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138011.442052:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138011.442116:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.442207:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.444348:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566528 00000100:00100000:1.0:1783138011.444360:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566528 00000100:00100000:1.0:1783138011.444457:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783138011.444468:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138011.444977:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566528:12345-0@lo:503:mount.lustre.0 Request processed in 509us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.444986:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783138011.445332:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138011.446239:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138011.446322:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138011.446821:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.446976:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138011.447020:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566656 00000100:00100000:2.0:1783138011.447028:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566656 00000100:00100000:2.0:1783138011.447116:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783138011.447126:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138011.447348:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566656:12345-0@lo:502:mount.lustre.0 Request processed in 213us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138011.447356:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783138011.447448:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138011.448015:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783138011.448076:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783138011.448130:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783138011.448196:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783138011.448234:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783138011.448280:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783138011.448330:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783138011.448534:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783138011.448695:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138011.448758:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.449089:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.449186:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566784 00000100:00100000:1.0:1783138011.449193:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566784 00000100:00100000:0.0:1783138011.449355:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783138011.449365:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138011.449594:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566784:12345-0@lo:502:mount.lustre.0 Request processed in 229us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138011.449776:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138011.449891:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783138011.449914:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:0.0:1783138011.450840:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000020:01000000:0.0:1783138011.451432:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138011.451508:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.451510:0:14860:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783138011.451519:0:14860:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dd0bfe000 00000020:00000080:0.0:1783138011.451521:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138011.451531:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.451533:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.451535:0:14860:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783138011.451537:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138011.451540:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.451541:0:14860:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783138011.452531:0:14860:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dd0bfe000 00000020:00000080:0.0:1783138011.452535:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138011.452747:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.452751:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.452753:0:14860:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783138011.452757:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138011.452760:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.452762:0:14860:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783138011.452766:0:14860:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5dd0bfe000 00000020:00000080:0.0:1783138011.452780:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138011.452843:0:14860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138011.452847:0:14860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138011.452848:0:14860:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783138011.452852:0:14860:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783138011.464763:0:14842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783138011.464821:0:14842:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138011.464837:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.464850:0:14842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138011.464911:0:14842:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783138011.464914:0:14842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5dd0bfe000 10000000:01000000:3.0:1783138011.464917:0:14842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5dd0bfe000 10000000:01000000:3.0:1783138011.464922:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783138011.464928:0:14842:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dd0bfe000 from 1 10000000:01000000:3.0:1783138011.464930:0:14842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783138011.464968:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.464977:0:14842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.465003:0:14842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138011.465029:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138011.465106:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.465155:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.465345:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322566912 00000100:00100000:0.0:1783138011.465354:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322566912 00000100:00100000:0.0:1783138011.465407:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783138011.465417:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322566912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138011.465431:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138011.466552:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02045e00/0x4691dfc3d66b8170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8169 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.466585:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02045e00/0x4691dfc3d66b8170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8169 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.466607:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02045e00/0x4691dfc3d66b8170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8169 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.466616:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02045e00, rc 0) 00000100:00100000:0.0:1783138011.466680:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322566912:12345-0@lo:101:mount.lustre.0 Request processed in 1263us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.466689:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783138011.470892:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322566912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138011.470935:0:14842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8170 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.470947:0:14842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8170 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138011.473799:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1783138011.474205:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138011.474495:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783138011.474542:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783138011.476769:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783138011.476891:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783138011.476930:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783138011.476981:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783138011.477020:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783138011.477054:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783138011.477102:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783138011.477139:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783138011.477201:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783138011.477253:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783138011.477290:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783138011.477319:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783138011.477389:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783138011.477427:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783138011.477462:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783138011.477510:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783138011.477576:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783138011.480799:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783138011.480927:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783138011.480968:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783138011.481001:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783138011.481046:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783138011.481079:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783138011.481111:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783138011.481181:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783138011.481220:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783138011.481309:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783138011.481317:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1783138011.488007:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138011.488080:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.488128:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.488182:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567040 00000100:00100000:0.0:1783138011.488190:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567040 00000100:00100000:0.0:1783138011.488236:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138011.488246:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138011.500820:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567040:12345-0@lo:501:mount.lustre.0 Request processed in 12563us (12728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.500848:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783138011.500992:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138011.501046:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138011.501091:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.501129:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df5c20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.502902:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567168 00000100:00100000:0.0:1783138011.502915:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567168 00000100:00100000:0.0:1783138011.502973:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783138011.502984:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138011.503209:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567168:12345-0@lo:503:mount.lustre.0 Request processed in 225us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.503217:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138011.503334:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783138011.504100:0:14842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783138011.504178:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138011.504237:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.504270:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df5c20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138011.504866:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567296 00000100:00100000:0.0:1783138011.504875:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567296 00000100:00100000:0.0:1783138011.504922:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783138011.504931:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138011.505170:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567296:12345-0@lo:502:mount.lustre.0 Request processed in 239us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138011.505178:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783138011.505284:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138011.505626:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783138011.505690:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783138011.505726:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783138011.505776:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783138011.505815:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783138011.505864:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783138011.505901:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783138011.505936:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783138011.506000:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783138011.506039:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783138011.506074:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783138011.506136:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783138011.506185:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783138011.506219:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783138011.506270:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783138011.506309:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783138011.506359:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783138011.506412:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783138011.506448:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783138011.506481:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783138011.506529:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783138011.506596:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783138011.506632:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783138011.506677:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783138011.506712:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783138011.506744:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783138011.506793:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783138011.506829:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783138011.506883:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783138011.506934:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783138011.506970:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783138011.507002:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783138011.507037:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783138011.507101:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783138011.507147:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783138011.507200:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783138011.507237:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783138011.507270:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783138011.507320:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783138011.507372:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783138011.507426:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138011.507508:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138011.507539:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2412d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138011.507737:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567424 00000100:00100000:2.0:1783138011.507747:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567424 00000100:00100000:2.0:1783138011.507810:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138011.507820:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138011.508054:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567424:12345-0@lo:502:mount.lustre.0 Request processed in 234us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138011.508063:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783138011.514496:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138011.514689:0:14842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783138011.514706:0:14842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783138011.517206:0:14865:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783138011.517245:0:14865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e5deffb3380) 00000020:00000080:3.0:1783138011.517267:0:14865:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1783138011.518056:0:14865:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dd0bfe000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138011.518061:0:14865:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dd0bfe000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138011.518064:0:14865:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dd0bfe000 3 00010000:00080000:3.0:1783138011.518682:0:14865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5dfb191800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1783138011.527567:0:14865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1783138011.527720:0:14865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783138011.527755:0:14865:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138011.527765:0:14865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4691dfc3d66b817e 00000100:00080000:0.0:1783138011.527775:0:14865:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138011.527780:0:14865:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e5dfb191800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783138011.527819:0:14865:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347df80 x1869755322567552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138011.527850:0:14865:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138011.528025:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138011.528030:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138011.528033:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138011.528042:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138011.528050:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322567552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138011.528125:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.528190:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567552 00000100:00100000:2.0:1783138011.528199:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567552 00000100:00100000:2.0:1783138011.528227:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138011.528234:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322567552:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783138011.528265:0:14207:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1783138011.528296:0:14207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4691dfc3d66b8185 00000004:00100000:2.0:1783138011.528312:0:14207:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138011.528354:0:14207:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138011.528410:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869755322567552:12345-0@lo:38:llog_process_th.0 Request processed in 174us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138011.528418:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138011.528488:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322567680:0@lo:400:kworker.0 00010000:00080000:3.0:1783138011.528512:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5cc347df80 x1869755322567552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138011.528517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138011.528523:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138011.528532:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1783138011.528539:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783138011.528571:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783138011.528574:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb191800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138011.528574:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567680 00000100:00100000:1.0:1783138011.528578:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567680 00000100:00100000:3.0:1783138011.528581:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869755322567552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783138011.528605:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138011.528611:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322567680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138011.528653:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869755322567680:12345-0@lo:400:kworker.0 Request processed in 41us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138011.528660:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783138011.528674:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e5df5cc8700 x1869755322567680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138011.528684:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869755322567680:0@lo:400:kworker.0 00000040:00080000:1.0:1783138011.529836:0:14865:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1783138011.530009:0:14842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783138011.530037:0:14842:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783138011.530062:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8170 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138011.530075:0:14842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7400/0x4691dfc3d66b8169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8170 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783138011.530121:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783138011.530123:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783138011.530124:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783138011.530125:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783138011.530127:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783138011.530128:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783138011.530129:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783138011.530132:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783138011.530133:0:14842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783138011.530136:0:14842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783138011.530139:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783138011.530140:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783138011.530141:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783138011.530142:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783138011.530143:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783138011.530144:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783138011.530145:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783138011.530146:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783138011.530147:0:14842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783138011.530169:0:14842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783138011.530187:0:14842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783138011.530240:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138011.530282:0:14842:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7f9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783138011.532990:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567808 00000100:00100000:3.0:1783138011.533003:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567808 00000100:00100000:3.0:1783138011.533068:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783138011.533078:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14842:x1869755322567808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783138011.533114:0:14202:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783138011.533128:0:14202:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783138011.555286:0:14202:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783138011.555308:0:14202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783138011.555329:0:14223:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783138011.555334:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783138011.555365:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.555384:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.555393:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.555572:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.555588:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 16 pid: 14202 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.555606:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322567936:0@lo:104: 00000100:00100000:2.0:1783138011.555681:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.555728:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df5c206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138011.556029:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322567936 00000100:00100000:1.0:1783138011.556038:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322567936 00000100:00100000:1.0:1783138011.556570:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138011.556582:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322567936:12345-0@lo:104: 00010000:00010000:1.0:1783138011.556597:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.556658:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1783138011.556669:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138011.556676:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138011.556678:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322567936:12345-0@lo:104: Request processed in 99us (997us total) trans 0 rc 0/0 00010000:00010000:3.0:1783138011.556684:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02045800 already unused, calling callback (ffffffffc1dc6c20) 00000100:00100000:1.0:1783138011.556686:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:3.0:1783138011.556688:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.556705:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138011.556712:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138011.556717:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783138011.556726:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322567936:0@lo:104: 00010000:00010000:1.0:1783138011.556746:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.556749:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.556755:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138011.556777:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138011.556784:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b80f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b80f9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138011.556787:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322568064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138011.556803:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138011.556805:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138011.556807:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138011.557056:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138011.557181:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568064 00000100:00100000:2.0:1783138011.557187:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568064 00010000:00010000:2.0:1783138011.557214:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 17 pid: 14202 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.557243:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138011.557251:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:3316:x1869755322568064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138011.557262:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138011.557267:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 17 pid: 14202 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557278:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 17 pid: 14202 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557290:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6d600/0x4691dfc3d66b80f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b80f2 expref: 17 pid: 14202 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557300:0:14194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557306:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783138011.557316:0:14194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002198167s 00010000:00010000:2.0:1783138011.557319:0:14194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557324:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557329:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557333:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557355:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3c400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138011.557359:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557370:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557391:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138011.557401:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138011.557598:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322568064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138011.557619:0:14223:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.557626:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138011.557633:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5df5e3c400/0x4691dfc3d66b818c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138011.559073:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322568064:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138011.559093:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138011.564898:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14842:x1869755322567808:12345-0@lo:253:mount.lustre.0 Request processed in 31810us (34645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138011.564914:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783138011.565019:0:14842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14842:1869755322567808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138011.565034:0:14842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783138011.565037:0:14842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138011.565038:0:14842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783138011.565039:0:14842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138011.565040:0:14842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138011.565041:0:14842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138011.565042:0:14842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138011.565043:0:14842:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138011.565044:0:14842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138011.565045:0:14842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783138011.565071:0:14842:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783138011.569694:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783138011.569848:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783138011.570005:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783138011.570161:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783138011.570308:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783138011.570637:0:14842:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783138011.571312:0:14842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783138011.619955:0:14842:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783138011.619966:0:14842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783138011.620002:0:14842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138011.620059:0:14842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138011.620074:0:14842:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783138011.620108:0:14842:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1783138011.706686:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138012.733636:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783138013.563030:0:14205:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783138013.563040:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5cc26de800 from 7 10000000:01000000:0.0:1783138013.563048:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783138013.563107:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138013.563128:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138013.563140:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138013.563168:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322568192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783138013.563242:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138013.563293:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7f9c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138013.563353:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568192 00000100:00100000:2.0:1783138013.563362:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568192 00000100:00100000:2.0:1783138013.563426:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783138013.563437:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+15:14205:x1869755322568192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138013.563451:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138013.563467:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8193 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138013.563494:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 16 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138013.563505:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 16 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138013.563516:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3ce00, rc 0) 00000100:00100000:2.0:1783138013.563596:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14205:x1869755322568192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138013.563603:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783138013.564075:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322568192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138013.564096:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138013.564106:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138013.564182:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322568320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783138013.564223:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138013.564261:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7df3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138013.564380:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568320 00000100:00100000:0.0:1783138013.564386:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568320 00000100:00100000:0.0:1783138013.564439:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783138013.564448:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14205:x1869755322568320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783138013.564467:0:14201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783138013.564488:0:14201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783138013.564492:0:14201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783138013.564606:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14205:x1869755322568320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138013.564614:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783138013.564654:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322568320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783138013.564712:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783138013.564720:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138013.566315:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138013.754735:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138014.798156:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138015.802697:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138016.826792:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138016.956688:0:1386:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138016.956695:0:1386:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138016.956698:0:1386:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138016.956701:0:1386:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783138016.956763:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322568448:0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.956834:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138016.956891:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322568576:0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.956914:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138016.956932:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138016.956937:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322568704:0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.956960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138016.956990:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568448 00000100:00100000:1.0:1783138016.956997:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568448 00000100:00100000:1.0:1783138016.957050:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783138016.957060:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3317:x1869755322568448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.957115:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3317:x1869755322568448:12345-0@lo:400:kworker.0 Request processed in 56us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138016.957123:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783138016.957159:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568576 00000100:00100000:1.0:1783138016.957163:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568576 00000100:00100000:1.0:1783138016.957189:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568704 00000100:00100000:1.0:1783138016.957192:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568704 00000100:00100000:1.0:1783138016.957225:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138016.957241:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322568576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.957276:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322568576:12345-0@lo:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138016.957282:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138016.957308:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138016.957314:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.957340:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322568704:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138016.957346:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783138016.957646:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dffe38a80 x1869755322568704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138016.957661:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322568704:0@lo:400:kworker.0 00010000:00080000:1.0:1783138016.957674:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5dffe39180 x1869755322568576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138016.957683:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322568576:0@lo:400:kworker.0 00000100:00100000:1.0:1783138016.957727:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322568448:0@lo:400:kworker.0 00000100:00080000:2.0:1783138016.958034:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783138017.214034:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783138017.852619:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138018.893061:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138019.606700:0:15210:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783138019.906696:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138020.734761:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138005/real 1783138005] req@ffff8e5cc347f480 x1869755322563968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138020.734793:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5cc347f480 x1869755322563968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138020.734803:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138005/real 1783138005] req@ffff8e5cc347e680 x1869755322564096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138020.734815:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e5cc347e680 x1869755322564096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138020.734846:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5def043800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138020.734953:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138020.734958:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322563968:0@lo:8:kworker.0 00000100:00080000:0.0:1783138020.734965:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138020.738568:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138020.738576:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783138020.738580:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5def043800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138020.738589:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1783138020.738595:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1783138020.738596:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322568832:0@lo:400:kworker.0 00000100:00080000:3.0:1783138020.738602:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e5def043800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1783138020.738674:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138020.738698:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5ccbb80 x1869755322568960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138020.738710:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138020.738714:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138020.738715:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138020.738718:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1783138020.738721:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783138020.738725:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783138020.738734:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5ccb480 x1869755322569088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138020.738744:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568832 00000100:00100000:2.0:1783138020.738751:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568832 00000100:00100000:3.0:1783138020.738781:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322569216:0@lo:400:kworker.0 00000100:00100000:2.0:1783138020.738796:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783138020.738804:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322568832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138020.738810:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138020.738848:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322569344:0@lo:400:kworker.0 00000100:00100000:3.0:1783138020.738872:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138020.738902:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569216 00000100:00100000:3.0:1783138020.738906:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569216 00000100:00100000:2.0:1783138020.738929:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322568832:12345-0@lo:400:kworker.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138020.738933:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569344 00000100:00100000:3.0:1783138020.738936:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569344 00000100:00100000:2.0:1783138020.738942:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783138020.738957:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138020.738962:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322569216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138020.739006:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322569216:12345-0@lo:400:kworker.0 Request processed in 43us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138020.739013:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138020.739027:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138020.739032:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322569344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138020.739062:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322569344:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138020.739067:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783138020.739086:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783138020.739113:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5cc8700 x1869755322569344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138020.739125:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322569344:0@lo:400:kworker.0 00000100:00100000:3.0:1783138020.739151:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322568832:0@lo:400:kworker.0 00010000:00080000:2.0:1783138020.739316:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5cc9f80 x1869755322569216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138020.739326:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322569216:0@lo:400:kworker.0 00000100:00080000:0.0:1783138020.739503:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138020.739509:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322564096:0@lo:8:kworker.0 00000100:00100000:0.0:1783138020.739530:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322568960:0@lo:8:kworker.0 00000100:00100000:0.0:1783138020.739580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138020.740258:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322569088:0@lo:8:kworker.0 00000100:00100000:0.0:1783138020.740304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138020.740516:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322568960 00000100:00100000:2.0:1783138020.740523:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322568960 00000100:00100000:2.0:1783138020.740849:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569088 00000100:00100000:2.0:1783138020.740854:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569088 00000100:00100000:2.0:1783138020.740870:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138020.740877:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322568960:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783138020.740906:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1783138020.740934:0:14844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b81a1 00002000:00100000:2.0:1783138020.740948:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e5dffbce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783138020.740953:0:14844:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783138020.740956:0:14844:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783138020.741305:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783138020.741443:0:14844:0:(import.c:65:import_set_state_nolock()) ffff8e5dffbcd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138020.741512:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1869755322568960:12345-0@lo:8:kworker.0 Request processed in 634us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138020.741519:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138020.741538:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138020.741542:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322569088:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783138020.741578:0:14844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138020.741618:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322569088:12345-0@lo:8:kworker.0 Request processed in 74us (1313us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138020.741630:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783138020.742134:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5ccbb80 x1869755322568960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138020.742157:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138020.742166:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783138020.742176:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138020.742181:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783138020.742184:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5def043800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138020.742238:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138020.742247:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322568960:0@lo:8:kworker.0 00000100:00080000:0.0:1783138020.742273:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138020.742278:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138020.742280:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322569088:0@lo:8:kworker.0 00000004:00080000:3.0:1783138020.742465:0:14230:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783138020.742522:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14230:1869755322569600:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783138020.742587:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138020.742704:0:14230:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783138020.742725:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138020.742736:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322569472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138020.742764:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138020.742794:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569600 00000100:00100000:3.0:1783138020.742799:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569600 00000100:00100000:3.0:1783138020.742843:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138020.742851:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14230:x1869755322569600:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783138020.743476:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569472 00000100:00100000:0.0:1783138020.743482:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569472 00000100:00100000:0.0:1783138020.743510:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138020.743517:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322569472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783138020.743556:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138020.743614:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869755322569472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138020.743621:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783138020.744699:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783138020.744806:0:14229:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783138020.745200:0:14229:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510637654059ns, next at 0ns, rc = 0 00002000:00080000:3.0:1783138020.747976:0:14844:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783138020.747987:0:14844:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783138020.747993:0:14844:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00010000:00080000:3.0:1783138020.760867:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5ccb800 x1869755322569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138020.760897:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322569472:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1783138020.763748:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.763766:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.763788:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.763794:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.763801:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.763820:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.763833:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.763855:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.763882:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138020.770003:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.770019:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.770035:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.770040:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.770063:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.770086:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.770093:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.770114:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.770116:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.770117:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.771801:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.771813:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771839:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.771843:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.771850:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771864:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771873:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771881:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771899:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.771911:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.771916:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771930:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.771933:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771942:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771957:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771964:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b6d502/0x4691dfc3d66b81af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.771980:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.771981:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.771983:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.772493:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.772500:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772509:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.772512:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.772517:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772526:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772540:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772566:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772579:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138020.772970:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.772975:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772983:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.772986:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.772990:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.772998:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773005:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773011:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773034:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138020.773044:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138020.773048:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773055:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.773058:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773067:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773080:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773087:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b81b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773103:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.773107:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773113:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.773117:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773133:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773143:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773150:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de0aacc1/0x4691dfc3d66b81bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773162:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.773163:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.773165:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.773580:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.773586:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773595:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.773598:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.773602:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773611:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773618:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773630:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773643:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.773653:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.773656:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773661:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.773664:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773671:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773682:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773688:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b81c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.773699:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.773701:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.773702:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.774065:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.774076:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774084:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.774088:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.774091:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774099:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774106:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774112:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774125:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.774133:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.774137:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774143:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.774146:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774154:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774170:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774178:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b81cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.774191:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.774193:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.774195:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.775537:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.780306:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.780319:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.780347:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.780352:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.780359:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.780374:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.780386:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.780393:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.780434:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138020.780460:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138020.780467:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.780475:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138020.780480:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.780490:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.780530:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.780538:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b81d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.780581:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.780583:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.780584:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.783226:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.783239:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.783256:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.783268:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.783275:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.783289:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.783300:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.783308:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.783327:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138020.786494:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.786508:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.786525:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.786535:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.786542:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.786568:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.786579:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.786587:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.786896:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783138020.791346:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138020.791362:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791378:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.791383:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791394:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791420:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791451:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f41d7329/0x4691dfc3d66b81d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791487:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.791491:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791498:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.791501:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791509:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791521:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791527:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff60dbd1/0x4691dfc3d66b81e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.791540:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.791542:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.791557:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.792316:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.793321:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.793331:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.793348:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.793352:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.793359:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.793372:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.793381:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.793394:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.793419:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138020.793744:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.793752:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.793765:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.793770:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.793778:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.793794:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.793802:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b81e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.793821:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.793824:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.793827:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.794092:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.794098:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794106:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.794109:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.794113:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794121:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794128:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794134:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794156:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138020.794479:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138020.794487:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.794510:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138020.794516:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.794525:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.794540:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.794576:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd19e001/0x4691dfc3d66b81ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783138020.794586:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.794594:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.794597:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.794601:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.794603:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.794626:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.794630:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.794634:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794645:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794653:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794661:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.794677:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138020.797093:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.797109:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797126:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.797130:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.797137:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797151:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797341:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797349:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797371:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138020.797386:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138020.797391:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797398:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.797403:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797411:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797428:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797435:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064bcdf85/0x4691dfc3d66b81f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797454:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.797465:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797471:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.797474:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797483:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797494:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797502:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfa6308/0x4691dfc3d66b81fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.797514:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.797516:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.797517:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.798989:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.799001:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799015:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.799018:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.799023:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799045:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799054:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799062:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799085:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138020.799960:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.799968:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799978:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.799982:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.799986:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.799996:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.800004:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.800023:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.800032:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783138020.801068:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.801078:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.801092:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.801096:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.801101:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.801113:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.801122:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.801130:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.801141:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783138020.801613:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783138020.801622:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801633:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138020.801638:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801649:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801675:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801682:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819a438a/0x4691dfc3d66b8203 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801705:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138020.801708:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801714:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138020.801717:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801724:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801732:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801738:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e53872/0x4691dfc3d66b820a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801748:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138020.801751:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801762:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:2.0:1783138020.801765:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801772:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801783:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801789:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab80f372/0x4691dfc3d66b8211 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138020.801802:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.801804:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138020.801806:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.802653:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.803398:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.803409:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.803432:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.803436:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.803442:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.803456:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.803466:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.803473:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.803493:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138020.803506:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.803512:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.803520:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.803524:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.803580:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.803598:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.803605:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008284ecb5/0x4691dfc3d66b8218 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.803622:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.803624:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.803626:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.804318:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.804325:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.804346:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.804350:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.804355:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.804366:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.804385:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.804392:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.804412:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138020.805060:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.805080:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.805089:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.805093:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.805101:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.805116:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.805136:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cccc562/0x4691dfc3d66b821f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.805159:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.805161:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.805162:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.808719:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.808734:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808753:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.808758:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.808766:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808782:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808794:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808802:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808907:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.808921:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.808927:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808935:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.808940:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808950:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808968:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808975:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000357122c8/0x4691dfc3d66b8226 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.808995:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.808997:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.808999:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.809516:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.809523:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809533:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.809542:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.809569:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809579:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809588:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809595:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809610:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.809618:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.809623:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809631:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.809635:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809643:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809655:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809673:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080a4747d/0x4691dfc3d66b822d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.809687:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.809689:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.809691:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.810087:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.810093:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.810102:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.810104:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.810108:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.810117:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.810125:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.810131:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.810152:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138020.810186:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138020.810192:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.810200:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138020.810204:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.810212:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.810224:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.810231:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da73d46c/0x4691dfc3d66b8234 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138020.810247:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.810248:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.810250:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.813797:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.813815:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813844:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.813848:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.813854:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813869:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813879:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813886:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813903:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.813915:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.813921:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813929:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0030c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.813934:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813941:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813963:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813970:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000846be4c/0x4691dfc3d66b823b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.813989:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.813991:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.813993:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.814439:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.814446:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814454:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.814457:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.814461:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814470:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814478:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814485:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814510:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.814520:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.814524:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814531:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.814535:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814561:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814573:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814580:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065e23eec/0x4691dfc3d66b8242 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814596:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.814597:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.814599:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.814957:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.814963:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814971:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.814980:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.814984:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.814993:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815000:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815007:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815020:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.815027:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.815030:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815036:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dc0031000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.815039:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815047:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815056:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815072:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155d4f15/0x4691dfc3d66b8249 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815085:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.815087:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.815088:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.815447:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.815453:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815461:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.815464:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.815468:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815477:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815486:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815493:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783138020.815508:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1783138020.815558:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.815571:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.815574:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815581:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.815584:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815591:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815601:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815607:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e040093c/0x4691dfc3d66b8250 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815620:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.815621:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.815622:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.815972:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.815977:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.815985:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.815988:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.815991:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816009:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816016:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816022:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816036:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.816042:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.816046:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816052:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.816055:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816063:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816073:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816080:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051ef2631/0x4691dfc3d66b8257 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.816101:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.816102:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.816104:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.818625:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.818706:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.818726:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.818730:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.818736:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.818749:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.818758:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.818766:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.818790:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138020.818807:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138020.818813:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.819433:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138020.819439:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.819448:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.819468:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.819475:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a9bc3f/0x4691dfc3d66b825e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.819505:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.819508:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138020.819510:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138020.820171:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783138020.820176:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.820188:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1783138020.820191:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138020.820197:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.820207:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.820221:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.820228:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138020.820252:0:14844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138020.820585:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138020.820593:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138020.820603:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138020.820607:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138020.820623:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138020.820803:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138020.820811:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e2c9d46/0x4691dfc3d66b8265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138020.820837:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138020.820839:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138020.820840:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783138020.822043:0:14844:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1783138020.822153:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14230:x1869755322569600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 79296us (79560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138020.822164:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138020.823581:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14230:1869755322569600:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783138020.823600:0:14230:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1783138020.830396:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14230:1869755322569728:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783138020.830480:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138020.830532:0:14230:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783138020.830798:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569728 00000100:00100000:0.0:1783138020.830807:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569728 00000100:00100000:0.0:1783138020.830987:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138020.830998:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14230:x1869755322569728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783138020.831060:0:14843:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1783138020.842753:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14230:x1869755322569728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11749us (12266us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783138020.842769:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138020.843428:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14230:1869755322569728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783138020.843446:0:14230:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1783138020.923624:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138021.947624:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783138022.154362:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1783138022.154384:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783138022.975758:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138023.996009:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138025.018685:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138026.042862:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138026.170803:0:1386:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138026.170814:0:1386:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138026.170820:0:1386:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138026.170832:0:1386:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1783138026.170841:0:1386:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783138026.170851:0:1386:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1783138026.170884:0:1386:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df5cc9c00 x1869755322570112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138026.170973:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322569856:0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171090:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.171186:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138026.171193:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322569984:0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171237:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.171287:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322570112:0@lo:8:kworker.0 00000100:00100000:3.0:1783138026.171335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.171366:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322570240:0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171393:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.171415:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138026.171419:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322570368:0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171437:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.171480:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569856 00000100:00100000:3.0:1783138026.171490:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569856 00000100:00100000:3.0:1783138026.171540:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783138026.171574:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322569856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171631:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322569856:12345-0@lo:400:kworker.0 Request processed in 58us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138026.171639:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783138026.171673:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322569984 00000100:00100000:3.0:1783138026.171676:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322569984 00000100:00100000:3.0:1783138026.171709:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570112 00000100:00100000:3.0:1783138026.171711:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570112 00000100:00100000:3.0:1783138026.171721:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138026.171725:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322569984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138026.171755:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322569984:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138026.171761:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138026.171772:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783138026.171785:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322570112:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783138026.171809:0:14844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138026.174996:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138026.175028:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322570496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138026.175116:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138026.175179:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570496 00000100:00100000:2.0:1783138026.175204:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570496 00000100:00100000:2.0:1783138026.175287:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138026.175299:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322570496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138026.175347:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783138026.175395:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322570496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138026.175402:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138026.175442:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783138026.175466:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322570496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138026.175515:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570240 00000100:00100000:2.0:1783138026.175519:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570240 00000100:00100000:2.0:1783138026.175574:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570368 00000100:00100000:2.0:1783138026.175577:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570368 00000100:00100000:2.0:1783138026.175595:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138026.175601:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322570240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138026.175640:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322570240:12345-0@lo:400:kworker.0 Request processed in 39us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138026.175647:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138026.175657:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138026.175662:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322570368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138026.175685:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869755322570368:12345-0@lo:400:kworker.0 Request processed in 23us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138026.175690:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1783138026.175732:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138026.175737:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138026.175763:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322569984:0@lo:400:kworker.0 00000100:00100000:2.0:1783138026.175776:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322569856:0@lo:400:kworker.0 00010000:00080000:2.0:1783138026.175838:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5cca680 x1869755322570368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138026.175851:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869755322570368:0@lo:400:kworker.0 00010000:00080000:2.0:1783138026.175863:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e5df5ccad80 x1869755322570240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138026.175871:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322570240:0@lo:400:kworker.0 00000100:00100000:2.0:1783138026.232835:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322570112:12345-0@lo:8:kworker.0 Request processed in 61038us (61489us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138026.232855:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783138026.232952:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138026.232960:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138026.232964:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322570112:0@lo:8:kworker.0 00000020:01000004:2.0:1783138026.802163:0:15513:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783138026.802168:0:15513:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783138026.802298:0:15513:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e5dffbc8000 00000020:01000004:2.0:1783138026.802314:0:15513:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783138026.802328:0:15513:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783138026.802343:0:15513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e5dc7ec99c0) 00000020:00000080:2.0:1783138026.802361:0:15513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783138026.863009:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783138026.864514:0:15513:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783138026.869903:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783138026.870393:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783138026.870722:0:15513:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783138026.871112:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:3.0:1783138026.871226:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 433: rc = 0 00100000:10000000:3.0:1783138026.871328:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:3.0:1783138026.871795:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:3.0:1783138026.872134:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 539: rc = 0 00100000:10000000:3.0:1783138026.872900:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:3.0:1783138026.873180:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 539: rc = 0 00100000:10000000:3.0:1783138026.873469:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:3.0:1783138026.873866:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 539: rc = 0 00000020:00000080:3.0:1783138026.875248:0:15513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783138026.875268:0:15513:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783138026.875366:0:15513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4691dfc3d66b8273 00000020:01000004:3.0:1783138026.875381:0:15513:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783138026.875414:0:15513:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783138026.875419:0:15513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783138026.875427:0:15513:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783138026.875462:0:15513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783138026.875468:0:15513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783138026.891333:0:15513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783138026.891410:0:15513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783138026.891416:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783138026.891418:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138026.891420:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138026.891421:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138026.891423:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138026.891425:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138026.891426:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138026.891429:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138026.891431:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138026.891437:0:15513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783138026.891439:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138026.891441:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138026.891442:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138026.891443:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138026.891444:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138026.891445:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138026.891446:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138026.891447:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138026.891448:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138026.891485:0:15513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783138026.891516:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138026.892035:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138026.892173:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dff95b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138026.895390:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570624 00000100:00100000:2.0:1783138026.895412:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570624 00000100:00100000:2.0:1783138026.895504:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783138026.895517:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:15513:x1869755322570624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783138026.896080:0:14201:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783138026.896086:0:14201:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783138026.896091:0:14201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783138026.910171:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:15513:x1869755322570624:12345-0@lo:253:mount.lustre.0 Request processed in 14641us (18122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138026.910222:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783138026.910407:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783138026.910430:0:15513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783138026.910435:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783138026.910437:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783138026.910439:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783138026.910440:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783138026.910441:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783138026.910443:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783138026.910445:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783138026.910447:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783138026.910449:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783138026.910474:0:15513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e5dffbc8000 from lustre-OST0001 10000000:01000000:3.0:1783138026.910512:0:15513:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783138026.910516:0:15513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783138026.910527:0:15513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e5df5e499c0 local copy 00010000:00010000:3.0:1783138026.910542:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138026.912078:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138026.912160:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.912276:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7df3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138026.912389:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570752 00000100:00100000:2.0:1783138026.912397:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570752 00000100:00100000:2.0:1783138026.912519:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783138026.912531:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:15513:x1869755322570752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138026.912893:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:15513:x1869755322570752:12345-0@lo:501:mount.lustre.0 Request processed in 363us (731us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138026.912903:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138026.912998:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783138026.913018:0:15513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783138026.913178:0:15513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783138026.913188:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138026.913199:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3da00/0x4691dfc3d66b8019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8020 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138026.913254:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e5dffbc8000 10000000:01000000:0.0:1783138026.913261:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783138026.913268:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783138026.913270:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783138026.913276:0:15513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783138026.913279:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783138026.913325:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138026.913335:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138026.913345:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138026.913364:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138026.913397:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.914344:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7df3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138026.914461:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322570880 00000100:00100000:1.0:1783138026.914470:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322570880 00000100:00100000:3.0:1783138026.917508:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783138026.917577:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:15513:x1869755322570880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138026.917605:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138026.917637:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a6800/0x4691dfc3d66b8281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b827a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138026.917676:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a6800/0x4691dfc3d66b8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b827a expref: 17 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138026.917691:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a6800/0x4691dfc3d66b8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b827a expref: 17 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138026.917703:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6800, rc 0) 00000100:00100000:3.0:1783138026.917821:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322570880:12345-0@lo:101:mount.lustre.0 Request processed in 294us (4422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138026.917849:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783138026.918067:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322570880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138026.918093:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8281 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138026.918117:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8281 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138026.919052:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783138026.920043:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138026.920335:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783138026.920389:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783138026.920429:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783138026.920485:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783138026.920525:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783138026.920598:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783138026.920670:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783138026.920678:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783138026.920784:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138026.920871:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.920926:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de022dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138026.922938:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571008 00000100:00100000:1.0:1783138026.922958:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571008 00000100:00100000:1.0:1783138026.923027:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783138026.923039:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138026.923806:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571008:12345-0@lo:501:mount.lustre.0 Request processed in 766us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138026.923817:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783138026.931203:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138026.931433:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138026.931637:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.931727:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de022dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138026.932992:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571136 00000100:00100000:1.0:1783138026.933010:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571136 00000100:00100000:1.0:1783138026.933873:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783138026.933887:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138026.934474:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571136:12345-0@lo:503:mount.lustre.0 Request processed in 586us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138026.934484:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783138026.934657:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138026.935486:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138026.935630:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138026.935704:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.943652:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd84b8240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138026.943796:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571264 00000100:00100000:3.0:1783138026.943808:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571264 00000100:00100000:2.0:1783138026.951673:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783138026.951690:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138026.952118:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571264:12345-0@lo:502:mount.lustre.0 Request processed in 430us (16412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138026.952127:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783138026.952347:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138026.952689:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783138026.952749:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783138026.952780:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783138026.952827:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783138026.952861:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783138026.952892:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783138026.952941:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783138026.952974:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783138026.953022:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1783138026.953066:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138026.953125:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138026.953163:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd84b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138026.953473:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571392 00000100:00100000:2.0:1783138026.953481:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571392 00000100:00100000:2.0:1783138026.953534:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783138026.953571:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138026.953775:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571392:12345-0@lo:502:mount.lustre.0 Request processed in 231us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138026.953783:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783138026.954084:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138026.954172:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1783138026.954186:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1783138026.955680:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783138026.955693:0:15514:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783138026.955702:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138026.955704:0:15514:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783138026.955710:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138026.955751:0:15514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e5dfa1c3380) 00000020:00000080:2.0:1783138026.955781:0:15514:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783138026.955788:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783138026.955865:0:15514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dffbc8000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783138026.955875:0:15514:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783138026.955887:0:15514:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4691dfc3d66b828f 00010000:00010000:2.0:1783138026.963467:0:15514:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1783138026.964191:0:15514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1783138026.967386:0:15514:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783138026.969124:0:15514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783138026.969140:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138026.969149:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138026.969151:0:15514:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783138026.969157:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138026.969163:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138026.969165:0:15514:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783138026.969169:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783138026.969171:0:15514:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783138026.969173:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138026.969176:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138026.969177:0:15514:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783138026.969179:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138026.969182:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138026.969183:0:15514:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783138026.969188:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783138026.969274:0:15514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138026.969278:0:15514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138026.969279:0:15514:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783138026.969283:0:15514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783138026.970688:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783138026.970737:0:15513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783138026.979698:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8281 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138026.979724:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5e02045800/0x4691dfc3d66b827a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8281 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138026.979738:0:15513:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dffbc8000 from 1 10000000:01000000:2.0:1783138026.979742:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138026.979803:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138026.979812:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138026.979824:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138026.979857:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138026.979954:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138026.980025:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc86a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138026.980161:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571520 00000100:00100000:1.0:1783138026.980172:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571520 00000100:00100000:1.0:1783138026.980255:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138026.980269:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:15513:x1869755322571520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138026.980287:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138026.980304:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8296 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138026.980656:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138026.980693:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138026.980702:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6d400, rc 0) 00000100:00100000:1.0:1783138026.980756:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571520:12345-0@lo:101:mount.lustre.0 Request processed in 491us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138026.980765:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138026.980833:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138026.980851:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138026.980860:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138026.984995:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783138026.988949:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138026.992673:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783138026.992828:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783138026.992931:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783138026.992940:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783138026.993071:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138026.993163:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138026.996352:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571648 00000100:00100000:3.0:1783138026.996376:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571648 00000100:00100000:3.0:1783138026.996480:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783138026.996494:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138026.996947:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571648:12345-0@lo:501:mount.lustre.0 Request processed in 455us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138026.996957:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783138026.999298:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:1.0:1783138026.999362:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138026.999436:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138026.999541:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138026.999602:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:3.0:1783138027.000407:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571776 00000100:00100000:3.0:1783138027.000433:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571776 00000100:00100000:3.0:1783138027.000514:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783138027.000526:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138027.001056:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571776:12345-0@lo:503:mount.lustre.0 Request processed in 530us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138027.001066:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783138027.001616:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138027.002266:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138027.002491:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138027.002609:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.002643:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df34a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783138027.002720:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322571904 00000100:00100000:0.0:1783138027.002728:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322571904 00000100:00100000:0.0:1783138027.002783:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783138027.002793:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138027.003076:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322571904:12345-0@lo:502:mount.lustre.0 Request processed in 284us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138027.003084:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783138027.003278:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322571904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138027.003718:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783138027.003777:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783138027.003827:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783138027.003866:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783138027.003899:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783138027.003947:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783138027.003982:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783138027.004016:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783138027.004053:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138027.004105:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.004134:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:0.0:1783138027.004226:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572032 00000100:00100000:0.0:1783138027.004232:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572032 00000100:00100000:0.0:1783138027.004278:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783138027.004286:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322572032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138027.004469:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322572032:12345-0@lo:502:mount.lustre.0 Request processed in 182us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138027.004482:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783138027.004738:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138027.004830:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783138027.004840:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783138027.010885:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138027.010904:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.010907:0:15518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138027.010917:0:15518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dffbc8000 00000020:00000080:3.0:1783138027.010920:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138027.010929:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138027.010932:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.010933:0:15518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138027.010936:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138027.010938:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.010939:0:15518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138027.010942:0:15518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e5dffbc8000 00000020:00000080:3.0:1783138027.010944:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138027.011029:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138027.011033:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.011034:0:15518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138027.011036:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138027.011039:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.011040:0:15518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138027.011043:0:15518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e5dffbc8000 00000020:00000080:3.0:1783138027.011045:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138027.011076:0:15518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138027.011079:0:15518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138027.011080:0:15518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783138027.011083:0:15518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783138027.028299:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783138027.028424:0:15513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138027.028454:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.028471:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138027.028644:0:15513:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783138027.028648:0:15513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e5dffbc8000 10000000:01000000:1.0:1783138027.028651:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e5dffbc8000 10000000:01000000:1.0:1783138027.028656:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138027.028663:0:15513:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e5dffbc8000 from 1 10000000:01000000:1.0:1783138027.028666:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783138027.028719:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.028728:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.028741:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138027.028774:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138027.028866:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.028935:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572160 00000100:00100000:1.0:1783138027.028944:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572160 00000100:00100000:1.0:1783138027.028997:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783138027.029007:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322572160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138027.029025:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138027.029041:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dd9e6c800/0x4691dfc3d66b82ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b82a4 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.029070:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dd9e6c800/0x4691dfc3d66b82ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b82a4 expref: 19 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.029095:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dd9e6c800/0x4691dfc3d66b82ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b82a4 expref: 19 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.029106:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dd9e6c800, rc 0) 00000100:00100000:1.0:1783138027.029146:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572160:12345-0@lo:101:mount.lustre.0 Request processed in 140us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138027.029154:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783138027.029226:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:1.0:1783138027.029253:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138027.029271:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82ab expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.029280:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b82ab expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138027.034171:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783138027.036975:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138027.052717:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783138027.052844:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783138027.052880:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783138027.052933:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783138027.052968:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783138027.053008:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783138027.053043:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783138027.053076:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783138027.053124:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783138027.053158:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783138027.053187:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783138027.053264:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783138027.053303:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783138027.053356:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783138027.053406:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783138027.053442:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783138027.053477:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783138027.053585:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783138027.053628:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783138027.053664:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783138027.053716:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783138027.053753:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783138027.053783:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783138027.053841:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783138027.053879:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783138027.053913:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783138027.053961:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783138027.053996:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783138027.054030:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783138027.054078:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1783138027.054114:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1783138027.054147:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1783138027.054180:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1783138027.054245:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1783138027.054284:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1783138027.054331:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1783138027.054369:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1783138027.054480:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1783138027.054492:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783138027.054656:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138027.054748:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.054822:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572288 00000100:00100000:1.0:1783138027.054830:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572288 00000100:00100000:1.0:1783138027.054896:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783138027.054906:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138027.055193:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572288:12345-0@lo:501:mount.lustre.0 Request processed in 287us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138027.055203:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783138027.065591:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de03660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138027.065645:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138027.065719:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138027.065805:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.065840:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de03660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138027.065982:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572416 00000100:00100000:2.0:1783138027.065990:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572416 00000100:00100000:2.0:1783138027.066047:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783138027.066058:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138027.066531:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572416:12345-0@lo:503:mount.lustre.0 Request processed in 473us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.066540:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783138027.067696:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138027.068473:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138027.068628:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138027.068726:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.068790:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572544 00000100:00100000:1.0:1783138027.068798:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572544 00000100:00100000:1.0:1783138027.068860:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783138027.068872:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138027.069247:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572544:12345-0@lo:502:mount.lustre.0 Request processed in 376us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138027.069258:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783138027.069333:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:1.0:1783138027.069356:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138027.069657:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783138027.069716:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783138027.069773:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783138027.069845:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783138027.069907:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783138027.069969:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783138027.070012:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783138027.070052:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783138027.070110:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783138027.070149:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783138027.070184:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783138027.070257:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783138027.070303:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783138027.070344:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783138027.070390:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783138027.070420:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783138027.070450:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783138027.070499:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783138027.070533:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783138027.070608:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783138027.070691:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783138027.070734:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783138027.070770:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783138027.070813:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783138027.070847:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783138027.070882:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783138027.070925:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783138027.070956:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783138027.070993:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783138027.071052:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783138027.071092:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783138027.071131:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783138027.071166:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00010000:00010000:2.0:1783138027.072482:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783138027.087506:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783138027.087690:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783138027.087779:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783138027.087836:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783138027.087876:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783138027.087927:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783138027.087963:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783138027.088037:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138027.088147:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.088220:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6754000 going to sleep for 11 seconds 00000100:00100000:0.0:1783138027.089454:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572672 00000100:00100000:0.0:1783138027.089470:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572672 00000100:00100000:0.0:1783138027.089571:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783138027.089584:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138027.089946:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322572672:12345-0@lo:502:mount.lustre.0 Request processed in 363us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138027.089955:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783138027.091457:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322572672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138027.091666:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783138027.091687:0:15513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783138027.103362:0:15523:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783138027.103385:0:15523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e5dc7ef4d40) 00000020:00000080:0.0:1783138027.103419:0:15523:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1783138027.103823:0:15523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e5dffbc8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783138027.103829:0:15523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e5dffbc8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783138027.103833:0:15523:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e5dffbc8000 3 00010000:00080000:0.0:1783138027.103873:0:15523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e5cc19f2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1783138027.109976:0:15523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1783138027.110123:0:15523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783138027.110178:0:15523:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138027.110200:0:15523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4691dfc3d66b82b9 00000100:00080000:0.0:1783138027.113733:0:15523:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138027.113750:0:15523:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e5cc19f2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1783138027.114019:0:15523:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5cc347d180 x1869755322572800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138027.114059:0:15523:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783138027.114331:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138027.114337:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783138027.114341:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138027.114347:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1783138027.114350:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783138027.114356:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1783138027.114372:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5df58fa300 x1869755322573184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138027.114424:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322573440:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.114519:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138027.114585:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138027.114591:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322572928:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.114623:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138027.114675:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322573056:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.114707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138027.114726:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138027.114732:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322573312:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.114752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138027.114782:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573440 00000100:00100000:2.0:1783138027.114790:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573440 00000100:00100000:2.0:1783138027.114839:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573312 00000100:00100000:2.0:1783138027.114856:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573312 00000100:00100000:2.0:1783138027.114879:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138027.114889:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322573440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.114949:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322573440:12345-0@lo:400:kworker.0 Request processed in 60us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.114956:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138027.114973:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138027.114979:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322573312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.115008:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869755322573312:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.115013:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138027.115131:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573056 00000100:00100000:2.0:1783138027.115136:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573056 00000100:00100000:2.0:1783138027.115163:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138027.115169:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322573056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.115200:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322573056:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.115219:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783138027.115263:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df58fb100 x1869755322573440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138027.115279:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322573440:0@lo:400:kworker.0 00010000:00080000:2.0:1783138027.115309:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5df58f9180 x1869755322573312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138027.115319:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869755322573312:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.115332:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322573056:0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.115368:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572928 00000100:00100000:2.0:1783138027.115372:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572928 00000100:00100000:2.0:1783138027.115402:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783138027.115410:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3316:x1869755322572928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138027.115447:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3316:x1869755322572928:12345-0@lo:400:kworker.0 Request processed in 39us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.115453:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783138027.115493:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322572928:0@lo:400:kworker.0 00000100:00100000:3.0:1783138027.116125:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322572800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138027.116178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138027.116268:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322573184:0@lo:8:kworker.0 00000100:00100000:3.0:1783138027.116294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783138027.116597:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783138027.116671:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783138027.116704:0:15513:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783138027.116722:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82ab expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.116734:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d600/0x4691dfc3d66b82a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82ab expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783138027.116791:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783138027.116793:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138027.116795:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138027.116796:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138027.116797:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138027.116799:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138027.116801:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138027.116803:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138027.116805:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138027.116809:0:15513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783138027.116812:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138027.116813:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138027.116814:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138027.116819:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138027.116820:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138027.116821:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138027.116822:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138027.116823:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138027.116824:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138027.116851:0:15513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783138027.116866:0:15513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322573568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138027.118435:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.118483:0:15513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5de03660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138027.118583:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573184 00000100:00100000:3.0:1783138027.118593:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573184 00000100:00100000:1.0:1783138027.118618:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573568 00000100:00100000:1.0:1783138027.118622:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573568 00000100:00100000:3.0:1783138027.118648:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138027.118657:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322573184:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783138027.118658:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783138027.118663:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:15513:x1869755322573568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783138027.118716:0:14200:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783138027.118731:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869755322573184:12345-0@lo:8:kworker.0 Request processed in 74us (2436us total) trans 0 rc -11/-11 20000000:01000000:1.0:1783138027.118734:0:14200:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783138027.118738:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138027.118778:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138027.118787:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138027.118792:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783138027.118797:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322573184:0@lo:8:kworker.0 00000100:00100000:2.0:1783138027.120200:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322572800 00000100:00100000:2.0:1783138027.120223:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322572800 00000100:00100000:2.0:1783138027.120274:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138027.120283:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869755322572800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783138027.120422:0:14207:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1783138027.120490:0:14207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4691dfc3d66b82c0 00000004:00100000:2.0:1783138027.120513:0:14207:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138027.124719:0:14207:0:(import.c:65:import_set_state_nolock()) ffff8e5df5962800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138027.124858:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869755322572800:12345-0@lo:38:llog_process_th.0 Request processed in 4570us (8673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.124871:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783138027.131362:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5cc347d180 x1869755322572800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138027.131403:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138027.131415:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783138027.131427:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783138027.131434:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783138027.131437:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5cc19f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783138027.131446:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869755322572800:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1783138027.148594:0:14200:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783138027.148617:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783138027.148701:0:14223:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783138027.148708:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783138027.148738:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138027.148760:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 19 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138027.148771:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138027.148820:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 19 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138027.148838:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 19 pid: 14200 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138027.148856:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322573696:0@lo:104: 00000100:00100000:0.0:1783138027.148942:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138027.148987:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5cc2c8e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138027.150017:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573696 00000100:00100000:1.0:1783138027.150029:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573696 00000100:00100000:1.0:1783138027.150092:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138027.150104:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322573696:12345-0@lo:104: 00010000:00010000:1.0:1783138027.150121:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150200:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138027.150219:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:14223:x1869755322573696:12345-0@lo:104: Request processed in 106us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138027.150227:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783138027.150257:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138027.150263:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150290:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044e00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:1.0:1783138027.150295:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150304:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138027.150591:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138027.150598:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138027.150635:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150642:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138027.150664:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150672:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044e00/0x4691dfc3d66b8193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b819a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150694:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138027.150696:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138027.150698:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138027.150712:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322573824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138027.150752:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138027.150809:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573824 00000100:00100000:1.0:1783138027.150813:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573824 00010000:00010000:1.0:1783138027.150833:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 20 pid: 14200 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138027.150863:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138027.150870:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+20:3317:x1869755322573824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138027.150883:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138027.150888:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 20 pid: 14200 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150899:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 20 pid: 14200 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150919:0:14193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150928:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783138027.150944:0:14193:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002238025s 00010000:00010000:1.0:1783138027.150949:0:14193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150956:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150964:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150970:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150976:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138027.150985:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.150994:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.151002:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.151013:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138027.151037:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+20:3317:x1869755322573824:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138027.151044:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138027.151081:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3317:1869755322573824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138027.151127:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5df5e3ce00/0x4691dfc3d66b819a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b8193 expref: 19 pid: 14200 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138027.151138:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14223:1869755322573696:0@lo:104: 00010000:00010000:1.0:1783138027.151151:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.151159:0:14223:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.151165:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138027.151172:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b82c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138027.157899:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:15513:x1869755322573568:12345-0@lo:253:mount.lustre.0 Request processed in 39220us (39458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138027.157918:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783138027.158039:0:15513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:15513:1869755322573568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138027.158061:0:15513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783138027.158065:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138027.158067:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138027.158069:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138027.158070:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138027.158071:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138027.158073:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138027.158074:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138027.158077:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138027.158078:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783138027.158094:0:15513:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783138027.161935:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783138027.162085:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783138027.162249:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783138027.162477:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783138027.162728:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783138027.162973:0:15513:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783138027.164629:0:15513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783138027.217471:0:15513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783138027.217485:0:15513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783138027.217530:0:15513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138027.217803:0:15513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138027.217827:0:15513:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783138027.217860:0:15513:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:3.0:1783138027.451229:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783138028.099777:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783138028.349508:0:14205:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138028.349519:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e5cc26de800 from 8 10000000:01000000:1.0:1783138028.349524:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138028.349613:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138028.349628:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138028.349642:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138028.349693:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322573952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138028.349783:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138028.349862:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783138028.350173:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322573952 00000100:00100000:0.0:1783138028.350183:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322573952 00000100:00100000:0.0:1783138028.350266:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783138028.350276:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322573952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138028.350304:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138028.350326:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b82d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b82ce expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138028.350354:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b82d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b82ce expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138028.350367:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02044e00/0x4691dfc3d66b82d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b82ce expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138028.350378:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044e00, rc 0) 00000100:00100000:0.0:1783138028.350438:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322573952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138028.350445:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783138028.350758:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322573952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138028.350777:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82d5 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138028.350850:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b82d5 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138028.350915:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322574080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138028.350955:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138028.351036:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138028.362945:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574080 00000100:00100000:3.0:1783138028.362968:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574080 00000100:00100000:3.0:1783138028.363047:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783138028.363060:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322574080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783138028.363095:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783138028.363119:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783138028.363122:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783138028.363317:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322574080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 258us (12360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138028.363326:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783138028.363403:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322574080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783138028.363480:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783138028.363492:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82d5 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138028.363505:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dd9e6d000/0x4691dfc3d66b82ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b82d5 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138029.119156:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138030.138747:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138031.163237:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138031.298639:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322574208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138031.298718:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138031.298802:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574208 00000100:00100000:2.0:1783138031.298810:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574208 00000100:00100000:2.0:1783138031.298865:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138031.298874:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322574208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138031.298916:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783138031.298958:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322574208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138031.298966:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783138031.298988:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138031.299024:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322574208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783138032.187030:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138032.317346:0:1386:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138032.317355:0:1386:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138032.317359:0:1386:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138032.317374:0:1386:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e5dc5dc2800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1783138032.317402:0:1386:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e5dffe39180 x1869755322574592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138032.317526:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322574336:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.317655:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.317714:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322574976:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.317765:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.317794:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138032.317799:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322574848:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.317821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.317847:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322574464:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.317878:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.317898:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138032.317903:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322574720:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.317926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.317979:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574336 00000100:00100000:1.0:1783138032.317988:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574336 00000100:00100000:1.0:1783138032.318041:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783138032.318052:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322574336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318112:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322574336:12345-0@lo:400:kworker.0 Request processed in 61us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.318121:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783138032.318176:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574976 00000100:00100000:1.0:1783138032.318181:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574976 00000100:00100000:1.0:1783138032.318216:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574848 00000100:00100000:1.0:1783138032.318219:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574848 00000100:00100000:1.0:1783138032.318235:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574720 00000100:00100000:1.0:1783138032.318238:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574720 00000100:00100000:1.0:1783138032.318251:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783138032.318257:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322574976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318292:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322574976:12345-0@lo:400:kworker.0 Request processed in 35us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.318299:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783138032.318320:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138032.318325:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322574848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318353:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322574848:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.318358:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138032.318370:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138032.318375:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322574720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318402:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322574720:12345-0@lo:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.318407:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138032.318425:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574464 00000100:00100000:1.0:1783138032.318428:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574464 00000100:00100000:1.0:1783138032.318455:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138032.318461:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322574464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318487:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322574464:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.318493:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783138032.318511:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783138032.318820:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dffe38380 x1869755322574720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138032.318836:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322574720:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318850:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322574464:0@lo:400:kworker.0 00010000:00080000:1.0:1783138032.318888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dffe39880 x1869755322574848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138032.318898:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322574848:0@lo:400:kworker.0 00000100:00100000:1.0:1783138032.318918:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322574336:0@lo:400:kworker.0 00010000:00080000:1.0:1783138032.318928:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dffe3aa00 x1869755322574976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138032.318936:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322574976:0@lo:400:kworker.0 00000100:00100000:0.0:1783138032.320128:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322574592:0@lo:8:kworker.0 00000100:00100000:0.0:1783138032.320216:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138032.320412:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322574592 00000100:00100000:0.0:1783138032.320420:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322574592 00000100:00100000:0.0:1783138032.320459:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138032.320468:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1869755322574592:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783138032.320505:0:14845:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1783138032.321049:0:14845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4691dfc3d66b82dc 00002000:00100000:0.0:1783138032.321149:0:14845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e5dfb15b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783138032.321155:0:14845:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783138032.321158:0:14845:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783138032.322420:0:14845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783138032.322468:0:14845:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb158800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138032.322677:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869755322574592:12345-0@lo:8:kworker.0 Request processed in 2206us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138032.322689:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783138032.322760:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dffe39180 x1869755322574592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138032.322781:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783138032.322792:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138032.322800:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783138032.322803:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138032.322823:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138032.322830:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869755322574592:0@lo:8:kworker.0 00000004:00080000:1.0:1783138032.323410:0:14232:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1783138032.323433:0:14232:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb063100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14232:1869755322575232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783138032.323484:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.323508:0:14232:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138032.323520:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138032.323528:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322575104:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783138032.323678:0:14231:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783138032.324124:0:14231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522216578506ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783138032.324663:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.324715:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575104 00000100:00100000:1.0:1783138032.324723:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575104 00000100:00100000:1.0:1783138032.324781:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138032.324792:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322575104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783138032.324835:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783138032.324895:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869755322575104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.324902:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783138032.324946:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e5dfb061500 x1869755322575104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138032.324970:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322575104:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783138032.324993:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138032.325537:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575232 00000100:00100000:0.0:1783138032.325708:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575232 00000100:00100000:0.0:1783138032.325757:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138032.325766:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14232:x1869755322575232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783138032.339763:0:14843:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783138032.339784:0:14843:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783138032.339792:0:14843:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1783138032.350275:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.350293:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350317:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.350322:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.350329:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350350:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350363:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350372:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350401:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138032.350938:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.350945:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350954:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.350958:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.350962:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350977:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350986:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.350993:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351013:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783138032.351030:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138032.351037:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351045:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.351050:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351060:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351079:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351085:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b82e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351110:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.351114:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351122:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.351125:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351132:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351140:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351146:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351156:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.351158:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.351160:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.351660:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.351667:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351676:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.351684:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.351689:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351699:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351707:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351716:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351728:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.351734:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.351739:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351745:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.351749:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351757:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351768:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351784:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b82f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.351797:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.351799:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.351800:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138032.354783:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.360673:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.360695:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360721:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.360727:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.360735:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360754:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360767:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360776:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360798:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.360817:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.360839:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360847:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.360852:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360862:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360883:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360890:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b82f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.360916:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.360919:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.360920:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.367803:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.367821:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367843:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.367848:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.367855:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367886:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367898:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367906:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367935:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.367952:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.367959:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367968:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.367973:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.367982:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.368002:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.368011:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b82ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.368040:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.368042:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.368044:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.373123:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.373139:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.373160:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.375398:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.375418:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375444:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375459:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375467:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375499:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.375521:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.375527:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375571:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6cc00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.375577:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375587:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375610:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375617:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d625a7/0x4691dfc3d66b8306 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.375644:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.375646:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.375648:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.377243:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.377257:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377284:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.377289:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.377295:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377308:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377328:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377335:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377354:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.377370:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.377376:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377386:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.377391:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377402:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377418:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377426:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d757f318/0x4691dfc3d66b830d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.377448:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.377455:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.377458:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.377998:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.378006:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378016:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.378019:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.378024:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378033:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378040:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378048:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378066:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.378076:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.378082:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378088:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6d800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.378092:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378110:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378122:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378128:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae83a46a/0x4691dfc3d66b8314 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378142:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.378144:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.378145:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.378693:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.378701:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378710:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.378714:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.378718:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378728:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378736:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378750:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378766:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.378777:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.378781:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378789:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.378793:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378801:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378813:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378820:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034c149c3/0x4691dfc3d66b831b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.378835:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.378837:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.378838:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.384635:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.384665:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384688:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.384693:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.384700:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384718:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384730:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384737:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384766:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.384791:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.384797:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384806:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6c400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.384810:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384820:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384848:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384856:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066e00bf5/0x4691dfc3d66b8322 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.384886:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.384888:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.384890:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.385524:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.385534:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385578:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.385582:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.385587:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385599:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385607:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385615:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385648:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.385661:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.385666:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385675:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6dc00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.385679:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385688:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385701:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385708:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a23cf2/0x4691dfc3d66b8329 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.385732:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.385734:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.385736:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.386212:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.386218:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386227:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.386237:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.386241:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386252:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386260:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386268:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386286:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.386296:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.386300:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386309:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ca00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.386312:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386320:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386333:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386353:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008eb9ce4/0x4691dfc3d66b8330 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386371:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.386373:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.386375:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.386846:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.386853:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386864:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.386868:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.386873:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386882:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386890:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386898:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386915:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.386924:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.386934:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386941:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6de00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.386944:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386951:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386964:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386971:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc43754/0x4691dfc3d66b8337 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.386986:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.386987:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.386989:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.392914:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.392936:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.392960:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.392967:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.392975:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393009:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393023:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393031:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393130:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138032.393738:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.393746:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393758:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.393762:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.393766:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393777:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393785:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.393803:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.396850:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138032.396871:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.396887:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6ce00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.396893:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.396907:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.396960:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.396969:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ca3951/0x4691dfc3d66b833e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.397007:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138032.397011:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.397018:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dd9e6da00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.397021:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.397029:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.397037:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.397044:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.397045:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.397048:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.397250:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783138032.397259:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005626ecbf/0x4691dfc3d66b8345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.397304:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.398124:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.398133:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398150:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.398155:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.398176:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398193:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398204:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398213:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398245:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.398257:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.398262:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398270:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1a00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.398275:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398283:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398299:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398307:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070de4bfa/0x4691dfc3d66b834c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398323:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.398325:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.398326:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.398829:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.398837:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398846:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.398856:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.398861:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398872:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398881:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398889:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398906:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.398916:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.398921:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398928:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.398932:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398939:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398950:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398969:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001184f566/0x4691dfc3d66b8353 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.398985:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.398987:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.398989:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.399433:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.399440:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399449:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.399453:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.399458:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399469:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399480:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399488:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399505:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.399512:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.399521:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399528:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.399532:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399540:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399583:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399590:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080972fb6/0x4691dfc3d66b835a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.399605:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.399606:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.399608:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.399993:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.399998:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400007:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.400011:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.400014:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400037:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400046:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400054:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400069:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.400078:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.400082:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400089:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0200 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.400092:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400099:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400108:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400115:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0a3e286/0x4691dfc3d66b8361 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.400133:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.400134:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.400137:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.405927:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.405943:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.405965:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.405970:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.405977:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.405994:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.406006:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.406015:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.406040:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138032.409408:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138032.409428:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.409464:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.409469:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.409484:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.409512:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.409519:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7197bb/0x4691dfc3d66b8368 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.409573:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.409575:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.409577:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.413643:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.413662:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413697:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.413703:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.413710:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413727:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413739:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413748:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413782:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.413809:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.413816:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413824:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.413829:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413838:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413868:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413875:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000264b876c/0x4691dfc3d66b836f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.413904:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.413906:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.413908:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783138032.415726:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1783138032.418067:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.418083:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418105:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.418110:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.418118:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418135:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418148:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418156:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418210:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138032.418230:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.418236:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418245:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.418250:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418260:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418453:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418460:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d502083f/0x4691dfc3d66b8376 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.418487:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.418489:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.418491:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.419079:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.419087:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419098:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.419110:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.419115:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419125:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419133:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419139:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419155:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138032.419786:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.419794:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419805:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.419809:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.419813:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419824:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419832:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419846:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419861:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783138032.419872:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138032.419877:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419884:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.419889:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419898:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419915:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419921:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d416c98a/0x4691dfc3d66b837d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419941:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138032.419945:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419962:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0800 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138032.419965:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419973:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419984:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.419990:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6a160ef/0x4691dfc3d66b8384 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.420003:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.420005:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138032.420006:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.421113:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.421124:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421139:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.421144:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.421149:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421161:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421187:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421194:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421219:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138032.421351:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138032.421358:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.421367:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1c00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.421371:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.421380:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.421401:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.421408:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca219b0a/0x4691dfc3d66b838b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.421427:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.421429:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.421431:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.421939:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.421946:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421956:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.421960:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.421965:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421974:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421982:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.421990:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422020:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138032.422370:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138032.422376:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.422384:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.422387:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.422395:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.422407:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.422414:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d6e646/0x4691dfc3d66b8392 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.422442:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.422443:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.422445:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138032.422724:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783138032.422730:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422740:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1783138032.422744:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138032.422748:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422756:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422764:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422770:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138032.422825:0:14843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783138032.423020:0:14843:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1783138032.423150:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14232:x1869755322575232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 97380us (99660us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138032.423163:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138032.423259:0:14232:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb063100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14232:1869755322575232:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783138032.423441:0:14232:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1783138032.423496:0:14232:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dfb063100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14232:1869755322575360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783138032.423535:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138032.423614:0:14232:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9ed0240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138032.423636:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575360 00000100:00100000:1.0:1783138032.423643:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575360 00000100:00100000:1.0:1783138032.423694:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783138032.423703:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14232:x1869755322575360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783138032.423752:0:14845:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1783138032.426408:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138032.426428:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.426446:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1600 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:0.0:1783138032.426452:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.426465:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.426495:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.426503:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038df5cbe/0x4691dfc3d66b8399 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138032.426557:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.426559:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138032.426561:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138032.426664:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138032.432927:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14232:x1869755322575360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9210us (9377us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783138032.432945:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138032.435162:0:14232:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dfb063100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14232:1869755322575360:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783138032.435199:0:14232:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1783138033.228762:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138034.234778:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138034.348888:0:15870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783138035.266199:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138036.282694:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138036.411790:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138036.411870:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138036.416874:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575488 00000100:00100000:1.0:1783138036.416896:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575488 00000100:00100000:1.0:1783138036.416994:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138036.417006:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322575488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783138036.417053:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783138036.417162:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138036.432588:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322575488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15570us (20702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138036.432604:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138036.432963:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138036.696359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138036.696533:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506304 00000100:00100000:1.0:1783138036.696570:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506304 00000100:00100000:1.0:1783138036.696626:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:1.0:1783138036.696635:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1869755299506304:12345-192.168.202.24@tcp:250:mount.lustre.0 00010000:00080000:1.0:1783138036.696690:0:14201:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from d431c32a-1317-4a85-9afc-df1a48112b4b@192.168.202.24@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1783138036.696721:0:14201:0:(genops.c:1406:class_connect()) connect: client d431c32a-1317-4a85-9afc-df1a48112b4b, cookie 0x4691dfc3d66b83a0 00000100:00080000:1.0:1783138036.697042:0:14201:0:(import.c:65:import_set_state_nolock()) ffff8e5dfa50a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138036.697371:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+5:2349:x1869755299506304:12345-192.168.202.24@tcp:250:mount.lustre.0 Request processed in 734us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138036.697380:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77 00000100:00100000:3.0:1783138036.703716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.703804:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506432 00000100:00100000:2.0:1783138036.703816:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506432 00000100:00100000:2.0:1783138036.703884:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:2.0:1783138036.703896:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+5:13708:x1869755299506432:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138036.703917:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138036.703941:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3d400/0x4691dfc3d66b83a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392296a expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.703976:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3d400/0x4691dfc3d66b83a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392296a expref: 6 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.704012:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3d400/0x4691dfc3d66b83a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392296a expref: 6 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.704023:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d400, rc 0) 00000100:00100000:2.0:1783138036.704101:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+6:13708:x1869755299506432:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 206us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.704241:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78 00000100:00100000:0.0:1783138036.709639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.709928:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506560 00000100:00100000:2.0:1783138036.709943:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506560 00000100:00100000:2.0:1783138036.709999:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:2.0:1783138036.710010:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+6:13708:x1869755299506560:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138036.711087:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+6:13708:x1869755299506560:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 1068us (1449us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138036.711100:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79 00000100:00100000:1.0:1783138036.723929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.724017:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506688 00000100:00100000:2.0:1783138036.724028:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506688 00000100:00100000:2.0:1783138036.724097:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:2.0:1783138036.724110:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+6:13708:x1869755299506688:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138036.724137:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138036.724158:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5df5e3d200/0x4691dfc3d66b83ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922971 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.724196:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5df5e3d200/0x4691dfc3d66b83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922971 expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.724209:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5df5e3d200/0x4691dfc3d66b83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922971 expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138036.724233:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d200, rc 0) 00000100:00100000:2.0:1783138036.724956:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+7:13708:x1869755299506688:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 845us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.724963:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80 00000100:00100000:0.0:1783138036.733662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.735674:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506816 00000100:00100000:2.0:1783138036.735700:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506816 00000100:00100000:2.0:1783138036.735777:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:2.0:1783138036.735788:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+7:13708:x1869755299506816:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138036.736536:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13708:x1869755299506816:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 746us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.736636:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81 00000100:00100000:0.0:1783138036.739722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.739786:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299506944 00000100:00100000:2.0:1783138036.739797:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299506944 00000100:00100000:2.0:1783138036.739897:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:2.0:1783138036.739909:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13708:x1869755299506944:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783138036.740147:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13708:x1869755299506944:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 239us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.740159:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82 00000100:00100000:1.0:1783138036.744953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.745229:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507072 00000100:00100000:2.0:1783138036.745242:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507072 00000100:00100000:2.0:1783138036.745342:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:2.0:1783138036.745355:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13726:x1869755299507072:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138036.745718:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13726:x1869755299507072:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 363us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.745735:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83 00000100:00100000:0.0:1783138036.782728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.782880:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507200 00000100:00100000:2.0:1783138036.782892:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507200 00000100:00100000:2.0:1783138036.783001:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:2.0:1783138036.783013:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13726:x1869755299507200:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138036.783351:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13726:x1869755299507200:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 340us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.783359:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84 00000100:00100000:0.0:1783138036.789608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138036.789801:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507328 00000100:00100000:1.0:1783138036.789812:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507328 00000100:00100000:1.0:1783138036.789859:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:1.0:1783138036.789868:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+8:13708:x1869755299507328:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138036.789887:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138036.789907:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5cc34a0a00/0x4691dfc3d66b83b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f2392299b expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138036.789943:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5cc34a0a00/0x4691dfc3d66b83b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392299b expref: 9 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138036.789955:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5cc34a0a00/0x4691dfc3d66b83b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f2392299b expref: 9 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138036.789964:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0a00, rc 0) 00000100:00100000:1.0:1783138036.790019:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+9:13708:x1869755299507328:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138036.790026:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85 00000100:00100000:1.0:1783138036.805661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.806012:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507456 00000100:00100000:2.0:1783138036.806023:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507456 00000100:00100000:2.0:1783138036.806093:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:2.0:1783138036.806104:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+9:13708:x1869755299507456:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783138036.806144:0:14202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783138036.806164:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783138036.806168:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783138036.806171:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783138036.806174:0:14202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783138036.818864:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+9:13708:x1869755299507456:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 12748us (13202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.818881:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 86 00000100:00100000:0.0:1783138036.830318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138036.830417:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507584 00000100:00100000:3.0:1783138036.830428:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507584 00000100:00100000:3.0:1783138036.830489:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:3.0:1783138036.830501:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+9:13708:x1869755299507584:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783138036.830521:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138036.837703:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239229a2 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138036.837755:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138036.837769:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138036.837779:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e02044400, rc 0) 00000100:00100000:0.0:1783138036.837863:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13708:x1869755299507584:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 7364us (7558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138036.837873:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87 00000100:00100000:1.0:1783138036.842441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.842571:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507712 00000100:00100000:2.0:1783138036.842583:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507712 00000100:00100000:2.0:1783138036.842648:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:2.0:1783138036.842659:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13708:x1869755299507712:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138036.842959:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13708:x1869755299507712:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 301us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.842974:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88 00000100:00100000:3.0:1783138036.845294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138036.846117:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507840 00000100:00100000:0.0:1783138036.846141:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507840 00000100:00100000:0.0:1783138036.846219:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:0.0:1783138036.846230:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13708:x1869755299507840:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783138036.846478:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13708:x1869755299507840:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 248us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138036.846487:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89 00000100:00100000:0.0:1783138036.853986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138036.855254:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299507968 00000100:00100000:3.0:1783138036.855272:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299507968 00000100:00100000:3.0:1783138036.855367:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:3.0:1783138036.855379:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd81bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13730:x1869755299507968:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138036.856332:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd81bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13730:x1869755299507968:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 944us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.856347:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90 00000100:00100000:1.0:1783138036.862806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.865518:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508096 00000100:00100000:2.0:1783138036.865618:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508096 00000100:00100000:2.0:1783138036.865688:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:2.0:1783138036.865699:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13730:x1869755299508096:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138036.866176:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13730:x1869755299508096:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 477us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.866186:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 91 00000100:00100000:3.0:1783138036.881042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138036.881233:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508224 00000100:00100000:1.0:1783138036.881250:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508224 00000100:00100000:1.0:1783138036.881327:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1783138036.881338:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1869755299508224:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783138036.881370:0:14208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 723ac79c-2210-42e9-aee9-241993d2ed66@192.168.202.24@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1783138036.881432:0:14208:0:(genops.c:1406:class_connect()) connect: client 723ac79c-2210-42e9-aee9-241993d2ed66, cookie 0x4691dfc3d66b83c3 00000004:00100000:1.0:1783138036.881466:0:14208:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783138036.881472:0:14208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1783138036.941192:0:14208:0:(import.c:65:import_set_state_nolock()) ffff8e5df5966800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138036.942015:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2349:x1869755299508224:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 60669us (60980us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.942031:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1783138036.947622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.948258:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508480 00000100:00100000:2.0:1783138036.948274:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508480 00000100:00100000:2.0:1783138036.948380:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:2.0:1783138036.948394:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508480:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138036.948473:0:14209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783138036.948627:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508480:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 235us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.948636:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00080000:1.0:1783138036.949147:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138036.949428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138036.949762:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508352 00000100:00100000:2.0:1783138036.949786:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508352 00000100:00100000:2.0:1783138036.949836:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:2.0:1783138036.949846:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:0:x1869755299508352:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138036.949871:0:14208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783138036.949947:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:0:x1869755299508352:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 101us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138036.949955:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783138036.953327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138036.953424:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508608 00000100:00100000:3.0:1783138036.953437:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508608 00000100:00100000:3.0:1783138036.953533:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1783138036.953590:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508608:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783138036.953849:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508608:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 305us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138036.953859:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1783138036.966791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138036.966844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138036.966911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138036.966999:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508992 00000100:00100000:3.0:1783138036.967013:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508992 00000100:00100000:3.0:1783138036.967091:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783138036.967105:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508992:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00080000:2.0:1783138036.969683:0:14210:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2472us 00000100:00100000:0.0:1783138036.970188:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508736 00000100:00100000:0.0:1783138036.970202:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508736 00000100:00100000:0.0:1783138036.970268:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299508864 00000100:00100000:0.0:1783138036.970272:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299508864 00000100:00100000:0.0:1783138036.970294:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:0.0:1783138036.970306:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299508736:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783138036.970359:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 723ac79c-2210-42e9-aee9-241993d2ed66@192.168.202.24@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1783138036.970401:0:14844:0:(genops.c:1406:class_connect()) connect: client 723ac79c-2210-42e9-aee9-241993d2ed66, cookie 0x4691dfc3d66b83ca 00002000:00100000:0.0:1783138036.970420:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 723ac79c-2210-42e9-aee9-241993d2ed66/ffff8e5e0135c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783138036.970439:0:14844:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783138036.971037:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783138036.971083:0:14844:0:(import.c:65:import_set_state_nolock()) ffff8e5e0135e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138036.971193:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2349:x1869755299508736:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 887us (4346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138036.971202:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:0.0:1783138036.971227:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:0.0:1783138036.971233:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299508864:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783138036.971254:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 723ac79c-2210-42e9-aee9-241993d2ed66@192.168.202.24@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1783138036.971280:0:14844:0:(genops.c:1406:class_connect()) connect: client 723ac79c-2210-42e9-aee9-241993d2ed66, cookie 0x4691dfc3d66b83d1 00002000:00100000:0.0:1783138036.971294:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 723ac79c-2210-42e9-aee9-241993d2ed66/ffff8e5dfb15e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783138036.971316:0:14844:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783138036.971468:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783138036.971487:0:14844:0:(import.c:65:import_set_state_nolock()) ffff8e5dfb15a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138036.971516:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2349:x1869755299508864:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 281us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138036.971523:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000004:00200000:1.0:1783138036.995040:0:14210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783138036.995336:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+6:13708:x1869755299508992:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 28224us (28550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138036.995355:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1783138037.215244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138037.215456:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509120 00000100:00100000:3.0:1783138037.215471:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509120 00000100:00100000:3.0:1783138037.215598:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1783138037.215624:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+6:13751:x1869755299509120:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:3.0:1783138037.215652:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138037.215703:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7200/0x4691dfc3d66b83d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f239229cc expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.215802:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.215821:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.215840:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138037.216106:0:14209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783138037.216111:0:14209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138037.216512:0:14209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.216599:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7200/0x4691dfc3d66b83d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229cc expref: 8 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.216634:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229cc expref: 7 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138037.216645:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138037.216649:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138037.216653:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783138037.216752:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+7:13751:x1869755299509120:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 1130us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138037.216762:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00010000:00010000:0.0:1783138037.310441:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138037.439306:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322575744:0@lo:400:kworker.0 00000100:00100000:1.0:1783138037.439397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138037.439464:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322576256:0@lo:400:kworker.0 00000100:00100000:1.0:1783138037.439492:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138037.439520:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783138037.439539:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322575616:0@lo:400:kworker.0 00000100:00100000:1.0:1783138037.439599:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138037.439636:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322576128:0@lo:400:kworker.0 00000100:00100000:1.0:1783138037.439659:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138037.441922:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322575872:0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.442016:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138037.442056:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322576384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138037.442106:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138037.442155:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138037.442162:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322576000:0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.442189:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138037.442657:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576256 00000100:00100000:2.0:1783138037.442668:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576256 00000100:00100000:2.0:1783138037.442730:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576128 00000100:00100000:2.0:1783138037.442734:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576128 00000100:00100000:2.0:1783138037.442752:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576000 00000100:00100000:2.0:1783138037.442755:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576000 00000100:00100000:2.0:1783138037.442771:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138037.442781:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322576256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.442862:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322576256:12345-0@lo:400:kworker.0 Request processed in 81us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138037.442871:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138037.442902:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138037.442908:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322576128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.442941:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322576128:12345-0@lo:400:kworker.0 Request processed in 33us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138037.442949:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138037.442963:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138037.442971:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322576000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.443006:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322576000:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138037.443011:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138037.443057:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322576128:0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.443079:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322576256:0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.443136:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322576000:0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.443158:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575616 00000100:00100000:2.0:1783138037.443162:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575616 00000100:00100000:2.0:1783138037.443194:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783138037.443201:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322575616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138037.443241:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322575616:12345-0@lo:400:kworker.0 Request processed in 41us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138037.443249:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783138037.443285:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322575616:0@lo:400:kworker.0 00000100:00100000:0.0:1783138037.446470:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576384 00000100:00100000:0.0:1783138037.446491:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576384 00000100:00100000:0.0:1783138037.446600:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138037.446626:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869755322576384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138037.446664:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138037.446777:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869755322576384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (4671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138037.446785:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138037.446866:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322576384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138037.446914:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575744 00000100:00100000:0.0:1783138037.446918:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575744 00000100:00100000:0.0:1783138037.446950:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322575872 00000100:00100000:0.0:1783138037.446953:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322575872 00000100:00100000:0.0:1783138037.446967:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138037.446973:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322575744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138037.447017:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322575744:12345-0@lo:400:kworker.0 Request processed in 44us (7621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138037.447024:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138037.447054:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138037.447060:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1869755322575872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138037.447095:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1869755322575872:12345-0@lo:400:kworker.0 Request processed in 35us (5081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138037.447101:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138037.447147:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322575744:0@lo:400:kworker.0 00000100:00100000:0.0:1783138037.447189:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322575872:0@lo:400:kworker.0 00000100:00080000:0.0:1783138037.447274:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783138037.447280:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1783138037.567403:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 723ac79c-2210-42e9-aee9-241993d2ed66 00000001:00100000:0.0:1783138037.567440:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783138037.567455:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1783138037.570214:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 723ac79c-2210-42e9-aee9-241993d2ed66 00000040:00080000:0.0:1783138037.691449:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783138038.334082:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138039.288398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138039.288483:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509248 00000100:00100000:3.0:1783138039.288496:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509248 00000100:00100000:3.0:1783138039.288692:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783138039.288706:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+7:13803:x1869755299509248:12345-192.168.202.24@tcp:41:lfs.0 00000004:00000024:3.0:1783138039.288766:0:14207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783138039.288879:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+7:13803:x1869755299509248:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 177us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138039.288887:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00080000:0.0:1783138039.291618:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138039.297155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.299633:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509376 00000100:00100000:0.0:1783138039.299655:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509376 00000100:00100000:0.0:1783138039.299867:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783138039.299880:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:723ac79c-2210-42e9-aee9-241993d2ed66+5:13803:x1869755299509376:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:0.0:1783138039.299938:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138039.300069:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:723ac79c-2210-42e9-aee9-241993d2ed66+5:13803:x1869755299509376:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 191us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.300077:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00080000:1.0:1783138039.300153:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138039.306954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.312891:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509504 00000100:00100000:2.0:1783138039.312915:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509504 00000100:00100000:3.0:1783138039.315940:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:3.0:1783138039.315962:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:723ac79c-2210-42e9-aee9-241993d2ed66+5:13803:x1869755299509504:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:3.0:1783138039.316021:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783138039.316604:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:723ac79c-2210-42e9-aee9-241993d2ed66+5:13803:x1869755299509504:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 645us (9664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138039.316631:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00080000:1.0:1783138039.318178:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783138039.355398:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138039.561630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.561808:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509632 00000100:00100000:0.0:1783138039.561822:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509632 00000100:00100000:0.0:1783138039.562088:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:0.0:1783138039.562141:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+10:13835:x1869755299509632:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783138039.562184:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138039.562219:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b83e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239229d3 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138039.562260:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229d3 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138039.562275:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d9000/0x4691dfc3d66b83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229d3 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138039.562286:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9000, rc 0) 00000100:00100000:0.0:1783138039.562371:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299509632:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 272us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.562380:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93 00000100:00100000:0.0:1783138039.602751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.603075:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509760 00000100:00100000:2.0:1783138039.603089:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509760 00000100:00100000:2.0:1783138039.603184:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:2.0:1783138039.603196:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299509760:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138039.603685:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299509760:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 488us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138039.604481:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94 00000100:00100000:1.0:1783138039.617932:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.618051:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299509888 00000100:00100000:0.0:1783138039.618064:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299509888 00000100:00100000:0.0:1783138039.618143:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:0.0:1783138039.618156:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299509888:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783138039.618764:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299509888:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 606us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.618774:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95 00000100:00100000:3.0:1783138039.624123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.627316:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510016 00000100:00100000:0.0:1783138039.627338:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510016 00000100:00100000:0.0:1783138039.627440:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:0.0:1783138039.627453:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13842:x1869755299510016:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783138039.628025:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13842:x1869755299510016:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 570us (3925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.628034:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96 00000100:00100000:1.0:1783138039.645787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.646001:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510144 00000100:00100000:2.0:1783138039.646014:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510144 00000100:00100000:2.0:1783138039.646085:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:2.0:1783138039.646097:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13842:x1869755299510144:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138039.647196:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13842:x1869755299510144:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 1093us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138039.647209:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97 00000100:00100000:3.0:1783138039.652713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.652884:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510272 00000100:00100000:1.0:1783138039.652898:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510272 00000100:00100000:1.0:1783138039.652976:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:1.0:1783138039.652988:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13835:x1869755299510272:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138039.653013:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138039.653038:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5cc34a1600/0x4691dfc3d66b83ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f239229fd expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.653088:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5cc34a1600/0x4691dfc3d66b83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229fd expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.653102:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5cc34a1600/0x4691dfc3d66b83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229fd expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.653122:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a1600, rc 0) 00000100:00100000:1.0:1783138039.653203:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13835:x1869755299510272:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 216us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138039.653240:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98 00000100:00100000:3.0:1783138039.657767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.659266:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510400 00000100:00100000:2.0:1783138039.659285:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510400 00000100:00100000:2.0:1783138039.659380:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:2.0:1783138039.659392:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13835:x1869755299510400:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783138039.659431:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783138039.659468:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783138039.659473:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783138039.659477:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783138039.659479:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783138039.665323:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13835:x1869755299510400:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 5916us (7556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138039.665341:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99 00000100:00100000:3.0:1783138039.670009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.670357:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510528 00000100:00100000:1.0:1783138039.670371:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510528 00000100:00100000:1.0:1783138039.670501:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:1.0:1783138039.670514:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13835:x1869755299510528:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138039.670538:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138039.670598:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a04 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.670648:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.670662:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138039.670683:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a1000, rc 0) 00000100:00100000:1.0:1783138039.670771:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13835:x1869755299510528:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 258us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138039.670779:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100 00000100:00100000:3.0:1783138039.679502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.679686:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510656 00000100:00100000:1.0:1783138039.679699:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510656 00000100:00100000:1.0:1783138039.679767:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:1.0:1783138039.679779:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13835:x1869755299510656:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138039.680212:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13835:x1869755299510656:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 433us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138039.680220:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101 00000100:00100000:2.0:1783138039.683979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.684153:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510784 00000100:00100000:1.0:1783138039.684168:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510784 00000100:00100000:1.0:1783138039.684252:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:1.0:1783138039.684264:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13835:x1869755299510784:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783138039.684987:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13835:x1869755299510784:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 721us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138039.684999:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102 00000100:00100000:3.0:1783138039.688519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.690346:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299510912 00000100:00100000:0.0:1783138039.690368:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299510912 00000100:00100000:0.0:1783138039.690967:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:0.0:1783138039.690984:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13847:x1869755299510912:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783138039.691426:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13847:x1869755299510912:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 445us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.691436:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103 00000100:00100000:3.0:1783138039.694268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.695819:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511040 00000100:00100000:2.0:1783138039.695840:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511040 00000100:00100000:0.0:1783138039.695965:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:0.0:1783138039.695981:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13847:x1869755299511040:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783138039.696539:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13847:x1869755299511040:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 560us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138039.702878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.703374:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104 00000100:00100000:0.0:1783138039.703460:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511168 00000100:00100000:0.0:1783138039.703470:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511168 00000100:00100000:0.0:1783138039.703512:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:0.0:1783138039.703520:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1869755299511168:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783138039.703570:0:14209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7ec00996-87cf-4d70-a85d-0eb7946f1e6c@192.168.202.24@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1783138039.703616:0:14209:0:(genops.c:1406:class_connect()) connect: client 7ec00996-87cf-4d70-a85d-0eb7946f1e6c, cookie 0x4691dfc3d66b83fb 00000004:00100000:0.0:1783138039.703660:0:14209:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783138039.703852:0:14209:0:(import.c:65:import_set_state_nolock()) ffff8e5dc57b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138039.703940:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2349:x1869755299511168:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 419us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.703960:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1783138039.714524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.714877:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511424 00000100:00100000:2.0:1783138039.714910:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511424 00000100:00100000:2.0:1783138039.715003:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1783138039.715015:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511424:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138039.715069:0:14207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783138039.715176:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511424:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 162us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138039.715184:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00080000:1.0:1783138039.716045:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138039.719770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138039.719951:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511296 00000100:00100000:2.0:1783138039.719964:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511296 00000100:00100000:2.0:1783138039.720040:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1783138039.720052:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:0:x1869755299511296:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138039.720097:0:14208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783138039.720214:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:0:x1869755299511296:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 156us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138039.720222:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1783138039.726482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138039.726690:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511552 00000100:00100000:0.0:1783138039.726704:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511552 00000100:00100000:0.0:1783138039.726787:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783138039.726799:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511552:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783138039.726923:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511552:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 126us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.726931:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1783138039.732062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.732119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138039.732160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138039.732644:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511936 00000100:00100000:3.0:1783138039.732658:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511936 00000100:00100000:3.0:1783138039.732736:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1783138039.732748:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511936:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783138039.733173:0:14211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783138039.733197:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511680 00000100:00100000:0.0:1783138039.733202:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511680 00000100:00100000:0.0:1783138039.733242:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299511808 00000100:00100000:0.0:1783138039.733246:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299511808 00000100:00100000:0.0:1783138039.733261:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783138039.733267:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299511680:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783138039.733299:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7ec00996-87cf-4d70-a85d-0eb7946f1e6c@192.168.202.24@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1783138039.733341:0:14844:0:(genops.c:1406:class_connect()) connect: client 7ec00996-87cf-4d70-a85d-0eb7946f1e6c, cookie 0x4691dfc3d66b8402 00002000:00100000:0.0:1783138039.733357:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7ec00996-87cf-4d70-a85d-0eb7946f1e6c/ffff8e5dc57b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783138039.733371:0:14844:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783138039.733639:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13835:x1869755299511936:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 893us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138039.733648:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00002000:00080000:0.0:1783138039.733665:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783138039.733704:0:14844:0:(import.c:65:import_set_state_nolock()) ffff8e5dc57b7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138039.733742:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2349:x1869755299511680:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 474us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.733748:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783138039.733782:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:0.0:1783138039.733787:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869755299511808:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783138039.734046:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7ec00996-87cf-4d70-a85d-0eb7946f1e6c@192.168.202.24@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1783138039.734069:0:14844:0:(genops.c:1406:class_connect()) connect: client 7ec00996-87cf-4d70-a85d-0eb7946f1e6c, cookie 0x4691dfc3d66b8409 00002000:00100000:0.0:1783138039.734079:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7ec00996-87cf-4d70-a85d-0eb7946f1e6c/ffff8e5dc57b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783138039.734086:0:14844:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783138039.734676:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783138039.734707:0:14844:0:(import.c:65:import_set_state_nolock()) ffff8e5dc5dc3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138039.734757:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2349:x1869755299511808:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 967us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138039.734779:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1783138039.889034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138039.889179:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512064 00000100:00100000:3.0:1783138039.889190:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512064 00000100:00100000:2.0:1783138039.890224:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1783138039.890241:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:13868:x1869755299512064:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:2.0:1783138039.890270:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138039.890303:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b8410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a2e expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.890389:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.890405:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.890444:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138039.890860:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783138039.890866:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783138039.890957:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.890990:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c800/0x4691dfc3d66b8410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.891903:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 7 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138039.891919:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138039.891923:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138039.891927:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3cc00, rc 0) 00000100:00100000:2.0:1783138039.892032:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+7:13868:x1869755299512064:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 1795us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138039.892041:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00010000:00010000:2.0:1783138040.381209:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138041.414272:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138041.530988:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138041.531015:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138041.531122:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138041.531701:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576512 00000100:00100000:2.0:1783138041.531711:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576512 00000100:00100000:2.0:1783138041.531790:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138041.531800:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322576512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138041.531838:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783138041.531900:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322576512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138041.531923:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138041.531976:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322576512:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783138041.532055:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1783138042.104958:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ec00996-87cf-4d70-a85d-0eb7946f1e6c 00000001:00100000:3.0:1783138042.104988:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 723ac79c-2210-42e9-aee9-241993d2ed66 00010000:00010000:2.0:1783138042.427223:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138042.554950:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322576768:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555027:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555091:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322577280:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555120:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555143:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783138042.555148:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322576640:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555233:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322577152:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555283:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322577024:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555305:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555320:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138042.555325:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322576896:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555344:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138042.555373:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577280 00000100:00100000:1.0:1783138042.555380:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577280 00000100:00100000:1.0:1783138042.555424:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577152 00000100:00100000:1.0:1783138042.555428:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577152 00000100:00100000:1.0:1783138042.555441:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577024 00000100:00100000:1.0:1783138042.555443:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577024 00000100:00100000:1.0:1783138042.555456:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138042.555465:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322577280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555519:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322577280:12345-0@lo:400:kworker.0 Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138042.555526:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138042.555578:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138042.555586:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322577152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555615:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869755322577152:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138042.555621:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138042.555633:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138042.555638:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322577024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555682:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322577024:12345-0@lo:400:kworker.0 Request processed in 43us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138042.555688:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138042.555708:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576768 00000100:00100000:1.0:1783138042.555711:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576768 00000100:00100000:1.0:1783138042.555731:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576896 00000100:00100000:1.0:1783138042.555733:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576896 00000100:00100000:1.0:1783138042.555748:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138042.555754:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322576768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555784:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322576768:12345-0@lo:400:kworker.0 Request processed in 30us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138042.555789:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138042.555799:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783138042.555804:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322576896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555829:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322576896:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138042.555834:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783138042.555851:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138042.555856:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138042.555886:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783138042.555907:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322576896:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555919:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322577024:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555945:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869755322577152:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555954:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322576768:0@lo:400:kworker.0 00000100:00100000:1.0:1783138042.555964:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322577280:0@lo:400:kworker.0 00000100:00100000:2.0:1783138042.556177:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322577408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138042.556217:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138042.556521:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577408 00000100:00100000:2.0:1783138042.556526:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577408 00000100:00100000:2.0:1783138042.556575:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138042.556582:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322577408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783138042.556610:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783138042.556653:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322577408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138042.556660:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138042.556698:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322577408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138042.558113:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322576640 00000100:00100000:0.0:1783138042.558123:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322576640 00000100:00100000:0.0:1783138042.558182:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783138042.558191:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322576640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138042.558269:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322576640:12345-0@lo:400:kworker.0 Request processed in 79us (3058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138042.558275:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783138042.558356:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322576640:0@lo:400:kworker.0 00000001:00100000:2.0:1783138042.605697:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ec00996-87cf-4d70-a85d-0eb7946f1e6c 00000001:00100000:3.0:1783138042.625655:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ec00996-87cf-4d70-a85d-0eb7946f1e6c 00000001:02000400:0.0:1783138042.840838:0:16078:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783138043.452452:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138044.474869:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138045.027418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138045.027474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138045.027513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138045.027514:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512192 00000100:00100000:2.0:1783138045.027526:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512192 00000100:00100000:3.0:1783138045.027592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138045.027616:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:3.0:1783138045.027622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138045.027632:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc9265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2350:x1869755299512192:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783138045.027663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138045.027664:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512704 00000100:00100000:0.0:1783138045.027670:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512704 00000100:00100000:2.0:1783138045.027724:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc9265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2350:x1869755299512192:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138045.027725:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512320 00000100:00100000:0.0:1783138045.027728:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512320 00000100:00100000:2.0:1783138045.027734:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 106 00000100:00100000:1.0:1783138045.027734:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512448 00000100:00100000:1.0:1783138045.027741:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512448 00000100:00100000:0.0:1783138045.027749:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1783138045.027757:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2350:x1869755299512704:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783138045.027777:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512960 00000100:00100000:1.0:1783138045.027779:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512576 00000100:00100000:1.0:1783138045.027783:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512576 00000100:00100000:2.0:1783138045.027794:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512960 00000100:00100000:1.0:1783138045.027813:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1783138045.027823:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299512448:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783138045.027829:0:14843:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138045.027850:0:14843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783138045.027866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138045.027887:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783138045.027893:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783138045.028017:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299512832 00000100:00100000:2.0:1783138045.028021:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299512832 00000100:00100000:2.0:1783138045.028043:0:14843:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138045.028052:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1783138045.028059:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299512576:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783138045.028100:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1783138045.028114:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2350:x1869755299512320:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783138045.028115:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299512576:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138045.028127:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1783138045.028142:0:14843:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138045.028150:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783138045.028155:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2350:x1869755299512320:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138045.028159:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299512960:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783138045.028172:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1783138045.028192:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299512960:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 35us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138045.028200:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1783138045.028212:0:14843:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138045.028219:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783138045.028225:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299512832:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783138045.028251:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299512832:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138045.028256:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00080000:2.0:1783138045.029031:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783138045.029039:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138045.029042:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138045.034883:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2350:x1869755299512704:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 7111us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138045.034916:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1783138045.044136:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299512448:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 16296us (16641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138045.044154:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00010000:00010000:1.0:1783138045.502532:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138046.523771:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138046.651884:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322577536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138046.651970:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138046.652224:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577536 00000100:00100000:0.0:1783138046.652234:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577536 00000100:00100000:0.0:1783138046.652323:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138046.652333:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322577536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783138046.652369:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138046.652417:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322577536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138046.652424:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783138046.652971:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138046.653013:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322577536:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1783138047.071636:0:16228:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebf132660 20000000:00000080:2.0:1783138047.071655:0:16228:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e5df5bc1800 uarg=0000000000000000 20000000:01000000:2.0:1783138047.071692:0:16228:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783138047.071699:0:16228:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783138047.071704:0:16228:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783138047.078712:0:16229:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1783138047.078941:0:16228:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783138047.089348:0:16228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783138047.089628:0:16228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089651:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089670:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089678:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089705:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089711:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089719:0:16228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089762:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089775:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 12 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.089789:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577664:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138047.089917:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089926:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 12 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.089935:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577792:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138047.089968:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.089976:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 18 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.089996:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577920:0@lo:104: 00000100:00100000:3.0:1783138047.090037:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138047.090088:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.090096:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 18 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.090104:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322578048:0@lo:104: 00000100:00100000:3.0:1783138047.090124:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138047.090162:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 18 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.090170:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 18 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.090391:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322577920 00000100:00100000:2.0:1783138047.090399:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322577920 00000100:00100000:2.0:1783138047.090440:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578048 00000100:00100000:2.0:1783138047.090443:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578048 00000100:00100000:2.0:1783138047.090460:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138047.090469:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+4:16228:x1869755322577920:12345-0@lo:104: 00010000:00010000:2.0:1783138047.090483:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090532:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783138047.090539:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+4:16228:x1869755322577920:12345-0@lo:104: Request processed in 71us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.090571:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138047.090591:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138047.090597:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:16228:x1869755322578048:12345-0@lo:104: 00010000:00010000:2.0:1783138047.090604:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090635:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783138047.090640:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:16228:x1869755322578048:12345-0@lo:104: Request processed in 44us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.090646:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783138047.090682:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138047.090688:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090696:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3de00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783138047.090701:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090710:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138047.090718:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138047.090724:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138047.090762:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090768:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138047.090787:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090794:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3de00/0x4691dfc3d66b8296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b829d expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090808:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138047.090812:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090818:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6a00 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783138047.090821:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090834:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138047.090851:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138047.090857:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138047.090871:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090877:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138047.090883:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090891:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a6a00/0x4691dfc3d66b815b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8162 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.090903:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138047.090905:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138047.090906:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138047.091210:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322578304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138047.091243:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138047.091286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138047.091292:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322578432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138047.091312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138047.091341:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578304 00000100:00100000:0.0:1783138047.091346:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578304 00010000:00010000:0.0:1783138047.091368:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 19 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138047.091389:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578432 00000100:00100000:0.0:1783138047.091392:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578432 00010000:00010000:0.0:1783138047.091402:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 20 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138047.091414:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138047.091419:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+20:3314:x1869755322578304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138047.091441:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138047.091447:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 20 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.091489:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783138047.091498:0:14193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1783138047.091860:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138047.092135:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322578176:0@lo:104: 00000100:00100000:1.0:1783138047.092275:0:14192:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783138047.092291:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783138047.092301:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+20:3314:x1869755322578432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138047.092312:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138047.092317:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 20 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.092528:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138047.092585:0:16228:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370000 going to sleep for 11 seconds 00000100:00100000:3.0:1783138047.092609:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577920:0@lo:104: 00000100:00100000:3.0:1783138047.092617:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322578048:0@lo:104: 00000100:00100000:2.0:1783138047.092702:0:14190:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783138047.092715:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578176 00000100:00100000:2.0:1783138047.092720:0:14190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578176 00000100:00100000:2.0:1783138047.092758:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138047.092764:0:14190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:16228:x1869755322578176:12345-0@lo:104: 00010000:00010000:2.0:1783138047.092774:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.092850:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783138047.092856:0:14190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+3:16228:x1869755322578176:12345-0@lo:104: Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.092863:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783138047.092905:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138047.092910:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.092918:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e02044000 already unused, calling callback (ffffffffc1dc6c20) 10000000:00010000:2.0:1783138047.092922:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.092932:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138047.092939:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138047.092945:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138047.092973:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.092980:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138047.093001:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.093008:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff8e5e02044000/0x4691dfc3d66b810e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4691dfc3d66b8115 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.093039:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138047.093040:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138047.093042:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138047.093066:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322578560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138047.093093:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.093163:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578560 00000100:00100000:2.0:1783138047.093167:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578560 00010000:00010000:2.0:1783138047.093194:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 21 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.093289:0:16230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783138047.093294:0:16230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1783138047.093896:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322578176:0@lo:104: 00000100:00100000:2.0:1783138047.096612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138047.096642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138047.096678:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783138047.096693:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513088 00000100:00100000:2.0:1783138047.096703:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513088 00010000:00010000:2.0:1783138047.096740:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 13 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.096764:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783138047.096772:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513216 00000100:00100000:2.0:1783138047.096775:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513216 00010000:00010000:2.0:1783138047.096790:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 14 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.096802:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783138047.096811:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138047.096820:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffce7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+21:3316:x1869755322578560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138047.096826:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 21 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138047.096919:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dd9e6d400/0x4691dfc3d66b829d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b8296 expref: 21 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138047.096938:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138047.096968:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138047.096975:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 20 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.096983:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 20 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.096993:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a7a00/0x4691dfc3d66b8115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b810e expref: 20 pid: 14202 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138047.096995:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+20:3314:x1869755322578304:12345-0@lo:103:ldlm_bl.0 Request processed in 5576us (5752us total) trans 0 rc 0/0 00010000:00010000:2.0:1783138047.097003:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138047.097003:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138047.097020:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783138047.097028:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1783138047.097033:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffce7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:3316:x1869755322578560:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138047.097035:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d431c32a-1317-4a85-9afc-df1a48112b4b+14:2353:x1869755299513088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783138047.097038:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783138047.097043:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138047.097061:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 14 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.097063:0:14193:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783138047.097069:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00010000:00010000:0.0:1783138047.097071:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 14 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.097076:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df58f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d431c32a-1317-4a85-9afc-df1a48112b4b+14:2353:x1869755299513216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138047.097082:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138047.097082:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138047.097087:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 14 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.097094:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 14 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138047.097101:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138047.097121:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d431c32a-1317-4a85-9afc-df1a48112b4b+14:2353:x1869755299513088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138047.097127:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00010000:00010000:3.0:1783138047.097207:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5cc34a1000/0x4691dfc3d66b83f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a04 expref: 13 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.097219:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577664:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138047.097230:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02044400/0x4691dfc3d66b83bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229a2 expref: 12 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138047.097248:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869755322577792:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138047.097279:0:16228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097578:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 17 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097591:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5e02045400/0x4691dfc3d66b8162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4691dfc3d66b815b expref: 17 pid: 14201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097604:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097623:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097638:0:14192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097645:0:14192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.097652:0:14192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138047.098363:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df58f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:2353:x1869755299513216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1281us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.098373:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1783138047.098437:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322578560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138047.098823:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322578304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138047.099449:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.099456:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7e00 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138047.099461:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.099471:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.099493:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.099507:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138047.099609:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3314:x1869755322578432:12345-0@lo:103:ldlm_bl.0 Request processed in 7308us (8294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138047.099618:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138047.099782:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322578432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138047.100535:0:16228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.100562:0:16228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138047.100569:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e5dea3a7e00/0x4691dfc3d66b841e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138047.547751:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138047.675866:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322579072:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.675940:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676002:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783138047.676009:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322578688:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676048:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676071:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322579200:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676092:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676116:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322578816:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676158:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322579328:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676196:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138047.676201:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322578944:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676221:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138047.676252:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578688 00000100:00100000:2.0:1783138047.676259:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578688 00000100:00100000:2.0:1783138047.676319:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783138047.676328:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322578688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676383:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:3316:x1869755322578688:12345-0@lo:400:kworker.0 Request processed in 55us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676390:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783138047.676427:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578816 00000100:00100000:2.0:1783138047.676431:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578816 00000100:00100000:2.0:1783138047.676456:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322578944 00000100:00100000:2.0:1783138047.676459:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322578944 00000100:00100000:2.0:1783138047.676504:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138047.676510:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322578816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676577:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322578816:12345-0@lo:400:kworker.0 Request processed in 36us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676583:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138047.676595:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138047.676601:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322578944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676644:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869755322578944:12345-0@lo:400:kworker.0 Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676649:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138047.676686:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3316:1869755322578688:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676717:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322578944:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676725:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869755322578816:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676762:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579072 00000100:00100000:2.0:1783138047.676764:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579072 00000100:00100000:2.0:1783138047.676788:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579200 00000100:00100000:2.0:1783138047.676790:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579200 00000100:00100000:2.0:1783138047.676800:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579328 00000100:00100000:2.0:1783138047.676802:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579328 00000100:00100000:2.0:1783138047.676813:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138047.676819:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322579072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676853:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869755322579072:12345-0@lo:400:kworker.0 Request processed in 34us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676859:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138047.676870:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138047.676875:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322579200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676908:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869755322579200:12345-0@lo:400:kworker.0 Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676913:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138047.676923:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138047.676928:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322579328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676955:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322579328:12345-0@lo:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138047.676960:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138047.676984:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869755322579200:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.676992:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df58fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869755322579072:0@lo:400:kworker.0 00000100:00100000:2.0:1783138047.677011:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322579328:0@lo:400:kworker.0 00000100:00080000:1.0:1783138047.678645:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138047.678656:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783138047.686845:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322579456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138047.686922:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138047.687051:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579456 00000100:00100000:0.0:1783138047.687061:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579456 00000100:00100000:0.0:1783138047.687116:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138047.687126:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322579456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138047.687165:0:14848:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138047.688097:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322579456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 969us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138047.688108:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138047.691377:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322579456:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1783138047.931715:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138048.571789:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783138048.954712:0:14205:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783138048.954720:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dffbc8000 from 10 10000000:01000000:2.0:1783138048.954726:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138048.954772:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138048.954784:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138048.954796:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138048.954835:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.954914:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138048.954974:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783138048.955052:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579584 00000100:00100000:3.0:1783138048.955061:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579584 00000100:00100000:3.0:1783138048.955117:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783138048.955127:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+16:14205:x1869755322579584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138048.955142:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138048.955156:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b842c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8425 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.955180:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b842c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8425 expref: 17 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.955190:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5dea3a7200/0x4691dfc3d66b842c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8425 expref: 17 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.955212:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7200, rc 0) 00000100:00100000:3.0:1783138048.955280:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138048.955287:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783138048.955440:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138048.955458:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b842c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138048.955466:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b842c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138048.955527:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138048.955588:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138048.955611:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6780240 going to sleep for 11 seconds 00000100:00100000:2.0:1783138048.955815:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579712 00000100:00100000:2.0:1783138048.955820:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579712 00000100:00100000:2.0:1783138048.955853:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783138048.955859:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.956103:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138048.956110:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783138048.956154:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.956204:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.956431:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138048.956464:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df3429f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138048.956641:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579840 00000100:00100000:1.0:1783138048.956647:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579840 00000100:00100000:1.0:1783138048.956681:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783138048.956687:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138048.956835:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138048.956842:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783138048.957003:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783138048.958052:0:16301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783138048.958492:0:14205:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783138048.958516:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138048.958526:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b842c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.958538:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5df5e3c800/0x4691dfc3d66b8425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b842c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138048.958572:0:14205:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783138048.958575:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5dd0bfe000 from 10 10000000:01000000:3.0:1783138048.958577:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783138048.958614:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.958623:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.958634:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138048.958658:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.958718:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138048.958752:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5e01370900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138048.958823:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322579968 00000100:00100000:1.0:1783138048.958830:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322579968 00000100:00100000:1.0:1783138048.958876:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783138048.958884:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+17:14205:x1869755322579968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138048.958896:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138048.958909:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5cc34a0200/0x4691dfc3d66b843a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8433 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138048.958949:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5cc34a0200/0x4691dfc3d66b843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8433 expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138048.958959:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5cc34a0200/0x4691dfc3d66b843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8433 expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138048.958968:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0200, rc 0) 00000100:00100000:1.0:1783138048.959014:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322579968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138048.959020:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783138048.959393:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322579968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138048.959408:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b843a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138048.959418:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b843a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138048.959474:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.959511:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138048.959538:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138048.959673:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580096 00000100:00100000:3.0:1783138048.959678:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580096 00000100:00100000:3.0:1783138048.959706:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783138048.959713:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322580096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.959980:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322580096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138048.959987:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783138048.962629:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.962698:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138048.962776:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138048.962819:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138048.963111:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580224 00000100:00100000:3.0:1783138048.963120:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580224 00000100:00100000:3.0:1783138048.963198:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783138048.963208:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322580224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.963753:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322580224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 544us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138048.963762:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783138048.963869:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783138048.969517:0:16302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783138048.969834:0:14205:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783138048.969857:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138048.969868:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b843a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.969880:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7e00/0x4691dfc3d66b8433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b843a expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138048.969891:0:14205:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783138048.969893:0:14205:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e5cc26de800 from 10 10000000:01000000:3.0:1783138048.969897:0:14205:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783138048.969939:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.969947:0:14205:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.969957:0:14205:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138048.969999:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.970081:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138048.970436:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd092e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138048.972307:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580352 00000100:00100000:0.0:1783138048.972322:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580352 00000100:00100000:0.0:1783138048.972373:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783138048.972382:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+18:14205:x1869755322580352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138048.972399:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138048.972417:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b8448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4691dfc3d66b8441 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138048.972445:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b8448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4691dfc3d66b8441 expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138048.972456:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d8000/0x4691dfc3d66b8448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4691dfc3d66b8441 expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138048.972466:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d8000, rc 0) 00000100:00100000:0.0:1783138048.972597:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322580352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138048.972614:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783138048.974292:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138048.974318:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8448 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138048.974330:0:14205:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4691dfc3d66b8448 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138048.974421:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138048.974481:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138048.974530:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6780540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138048.974701:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580480 00000100:00100000:3.0:1783138048.974709:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580480 00000100:00100000:3.0:1783138048.974754:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783138048.974763:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322580480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.975048:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322580480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138048.975057:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783138048.975709:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138048.975780:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138048.975831:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138048.975869:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc6780540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138048.975924:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580608 00000100:00100000:3.0:1783138048.975930:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580608 00000100:00100000:3.0:1783138048.975975:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783138048.975984:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322580608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138048.976196:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:14205:x1869755322580608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138048.976204:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783138048.976440:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:14205:1869755322580608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783138048.982461:0:16303:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783138048.982729:0:14205:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783138048.982781:0:14205:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138048.982795:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8448 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138048.982806:0:14205:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff8e5dea3a7000/0x4691dfc3d66b8441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4691dfc3d66b8448 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138049.124884:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138049.132144:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513344 00000100:00100000:0.0:1783138049.132161:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513344 00000100:00100000:0.0:1783138049.132211:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:0.0:1783138049.132219:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+11:13722:x1869755299513344:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138049.132233:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138049.132248:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5e021d8a00/0x4691dfc3d66b844f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a35 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138049.132271:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5e021d8a00/0x4691dfc3d66b844f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a35 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138049.132279:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5e021d8a00/0x4691dfc3d66b844f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a35 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138049.132287:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d8a00, rc 0) 00000100:00100000:0.0:1783138049.132342:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513344:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 125us (7471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138049.132347:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:3.0:1783138049.144401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138049.144449:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513472 00000100:00100000:3.0:1783138049.144460:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513472 00000100:00100000:3.0:1783138049.144509:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:3.0:1783138049.144519:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513472:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138049.144803:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513472:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 285us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138049.144809:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:0.0:1783138049.158820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138049.158889:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513600 00000100:00100000:3.0:1783138049.158898:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513600 00000100:00100000:3.0:1783138049.158943:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:3.0:1783138049.158951:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513600:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138049.159169:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513600:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 217us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138049.159178:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:3.0:1783138049.178085:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138049.178231:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513728 00000100:00100000:1.0:1783138049.178242:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513728 00000100:00100000:1.0:1783138049.178302:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:1.0:1783138049.178312:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+12:13722:x1869755299513728:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138049.178332:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138049.178353:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e5cc34a0600/0x4691dfc3d66b8456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a3c expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138049.178384:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e5cc34a0600/0x4691dfc3d66b8456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a3c expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138049.178398:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e5cc34a0600/0x4691dfc3d66b8456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a3c expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138049.178409:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0600, rc 0) 00000100:00100000:1.0:1783138049.178473:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13722:x1869755299513728:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 161us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138049.178480:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:2.0:1783138049.183457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138049.183532:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513856 00000100:00100000:3.0:1783138049.183692:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513856 00000100:00100000:3.0:1783138049.183794:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:3.0:1783138049.183814:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13722:x1869755299513856:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138049.184445:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13722:x1869755299513856:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 639us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138049.184455:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:1.0:1783138049.191822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138049.193692:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299513984 00000100:00100000:2.0:1783138049.193708:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299513984 00000100:00100000:2.0:1783138049.195289:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:2.0:1783138049.195309:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13722:x1869755299513984:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138049.195577:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d431c32a-1317-4a85-9afc-df1a48112b4b+13:13722:x1869755299513984:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 274us (3775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138049.195585:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00010000:00010000:2.0:1783138049.595145:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138050.147906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.147947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.147987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.148018:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.148073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.148109:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138050.148141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138050.148204:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514368 00000100:00100000:0.0:1783138050.148215:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514368 00000100:00100000:1.0:1783138050.148270:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514624 00000100:00100000:0.0:1783138050.148274:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514880 00000100:00100000:1.0:1783138050.148275:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514624 00000100:00100000:0.0:1783138050.148276:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514880 00000100:00100000:0.0:1783138050.148287:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514496 00000100:00100000:0.0:1783138050.148289:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514496 00000100:00100000:1.0:1783138050.148303:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514240 00000100:00100000:1.0:1783138050.148306:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514240 00000100:00100000:0.0:1783138050.148318:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514752 00000100:00100000:0.0:1783138050.148321:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514752 00000100:00100000:1.0:1783138050.148326:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1783138050.148333:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1783138050.148336:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2351:x1869755299514624:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138050.148338:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2351:x1869755299514368:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1783138050.148414:0:16139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1783138050.148429:0:16139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2351:x1869755299514880:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783138050.148492:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2351:x1869755299514624:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 156us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138050.148508:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:1.0:1783138050.148526:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:1.0:1783138050.148532:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+6:2351:x1869755299514240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783138050.148623:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299514112 00000100:00100000:3.0:1783138050.148628:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299514112 00000100:00100000:3.0:1783138050.148657:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1783138050.148659:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2351:x1869755299514368:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 320us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138050.148663:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2351:x1869755299514112:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138050.148666:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783138050.148679:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783138050.148684:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2351:x1869755299514496:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1783138050.148695:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2351:x1869755299514112:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138050.148702:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1783138050.148702:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2351:x1869755299514496:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 18us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138050.148708:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783138050.148716:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783138050.148722:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2351:x1869755299514752:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138050.148742:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2351:x1869755299514752:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 21us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138050.148748:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00080000:0.0:1783138050.148763:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783138050.148767:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783138050.148769:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138050.151378:0:16139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2351:x1869755299514880:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 2935us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138050.151395:0:16139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:1.0:1783138050.155399:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+6:2351:x1869755299514240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 6854us (7312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138050.156148:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00010000:00010000:0.0:1783138050.620623:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138051.152945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.153065:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515008 00000100:00100000:2.0:1783138051.153093:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515008 00000100:00100000:2.0:1783138051.153316:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:2.0:1783138051.153329:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:14378:x1869755299515008:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138051.153353:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138051.153375:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b845d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a43 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153740:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153757:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153770:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153786:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153793:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.153799:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.154763:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b8472 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.154781:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b8472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.154800:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b8472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138051.154901:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783138051.154907:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783138051.155007:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b8472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155033:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155038:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155045:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155052:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.155057:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155065:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155079:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138051.155650:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.155659:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155667:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155696:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155702:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155708:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155713:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.155716:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155722:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155732:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e5de2d1c200) 00010000:00010000:2.0:1783138051.155735:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.155738:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155743:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b846b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155786:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b845d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a43 expref: 8 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155798:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3d800/0x4691dfc3d66b8472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a43 expref: 7 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.155817:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:2.0:1783138051.155820:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138051.155822:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3d800, rc 0) 00000100:00100000:2.0:1783138051.155916:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+7:14378:x1869755299515008:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 2589us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138051.155926:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1783138051.161720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.163330:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515264 00000100:00100000:3.0:1783138051.163346:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515264 00000100:00100000:3.0:1783138051.164781:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1783138051.164810:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+7:14378:x1869755299515264:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138051.164835:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.164860:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b8479 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a4a expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.164956:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.164973:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.164984:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.165053:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.165061:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.165083:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.178809:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b848e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.178834:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b848e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.178847:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b848e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.178864:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783138051.182469:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.182487:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.182494:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.182501:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.182506:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.182514:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.182533:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e5de2d1c100) 00010000:00010000:3.0:1783138051.182536:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.185280:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185294:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8480 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185318:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185327:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185335:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185341:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.185345:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185352:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185367:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e5dcc955800) 00010000:00010000:3.0:1783138051.185370:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.185373:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.185389:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8487 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.190167:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b8479 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a4a expref: 10 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.190234:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6c00/0x4691dfc3d66b848e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a4a expref: 9 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.190244:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5dcc955500) 00010000:00010000:3.0:1783138051.190247:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.190251:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6c00, rc 0) 00000100:00100000:3.0:1783138051.190343:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+9:14378:x1869755299515264:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 25545us (28632us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783138051.190354:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1783138051.195048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.195129:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515392 00000100:00100000:3.0:1783138051.195145:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515392 00000100:00100000:3.0:1783138051.195228:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:3.0:1783138051.195239:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+9:14378:x1869755299515392:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783138051.195372:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+9:14378:x1869755299515392:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.195381:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1783138051.198990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.199358:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515520 00000100:00100000:2.0:1783138051.199370:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515520 00000100:00100000:2.0:1783138051.199436:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:2.0:1783138051.199448:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+9:14384:x1869755299515520:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783138051.199468:0:16140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138051.199488:0:16140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b849c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a51 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199594:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199609:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199620:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199635:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199642:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199668:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199896:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199901:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199906:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199909:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.199913:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199918:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199929:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138051.199931:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.199934:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199938:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199946:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199950:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199958:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199962:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.199964:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199967:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199971:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e5de2d1c200) 00010000:00010000:2.0:1783138051.199972:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.199974:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.199977:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.200000:0:16140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b849c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a51 expref: 10 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.200006:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138051.200008:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.200022:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b849c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a51 expref: 10 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.200032:0:16140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3de00, rc 0) 00000100:00100000:2.0:1783138051.200091:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+9:14384:x1869755299515520:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 646us (1111us total) trans 0 rc 301/301 00000100:00100000:2.0:1783138051.200765:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783138051.206487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138051.206744:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515648 00000100:00100000:1.0:1783138051.206755:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515648 00000100:00100000:1.0:1783138051.206814:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1783138051.206824:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:723ac79c-2210-42e9-aee9-241993d2ed66+9:14384:x1869755299515648:12345-192.168.202.24@tcp:700:lfs.0 00000100:00100000:1.0:1783138051.206961:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:723ac79c-2210-42e9-aee9-241993d2ed66+9:14384:x1869755299515648:12345-192.168.202.24@tcp:700:lfs.0 Request processed in 138us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138051.206969:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1783138051.211385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.211722:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299515904 00000100:00100000:3.0:1783138051.211734:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299515904 00000100:00100000:3.0:1783138051.211809:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1783138051.211821:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+9:14384:x1869755299515904:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:3.0:1783138051.211887:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138051.211916:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b83df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f239229cc expref: 9 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.211940:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138051.211961:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138051.222535:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.222592:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 5 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.222603:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.222658:0:14209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 5 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.222678:0:14209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 5 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.222697:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322580736:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783138051.222963:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c01b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783138051.241666:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138051.241868:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322580736:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783138051.241910:0:14209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138051.242364:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516032 00000100:00100000:3.0:1783138051.242373:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516032 00010000:00010000:3.0:1783138051.242510:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 6 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138051.242615:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1783138051.242626:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2353:x1869755299516032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138051.242640:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138051.242646:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 6 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242658:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 6 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242680:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a2e expref: 6 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242697:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138051.242702:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242712:0:14194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242720:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.242739:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783138051.242876:0:14209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.242884:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.242915:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.242925:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.242934:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138051.245597:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2353:x1869755299516032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2953us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.245611:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000004:00200000:0.0:1783138051.246183:0:14209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783138051.246200:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246210:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246218:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246223:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783138051.246228:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246235:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246261:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:0.0:1783138051.246264:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783138051.246268:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.246274:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b84b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783138051.246300:0:14209:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000374601e2 reply state 0000000030af5a48 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138051.246309:0:14209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783138051.246415:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+10:14384:x1869755299515904:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 34596us (35040us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783138051.246423:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00010000:00010000:2.0:1783138051.252142:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252168:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252177:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252184:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.252202:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252211:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252229:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e5dcc9ecd00) 00010000:00010000:2.0:1783138051.252232:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138051.252237:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.252243:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b84b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.331001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.331384:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516160 00000100:00100000:3.0:1783138051.331395:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516160 00000100:00100000:3.0:1783138051.331454:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1783138051.331465:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+9:14392:x1869755299516160:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:3.0:1783138051.331494:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.331519:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b84bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a58 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331614:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b84c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331628:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b84c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331638:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b84c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.331696:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783138051.331700:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138051.331742:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b84c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331768:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b84bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a58 expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331789:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6200/0x4691dfc3d66b84c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a58 expref: 10 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.331817:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:3.0:1783138051.331820:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138051.331824:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6200, rc 0) 00000100:00100000:3.0:1783138051.331891:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+10:14392:x1869755299516160:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 427us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.331899:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1783138051.351665:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.351771:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516288 00000100:00100000:2.0:1783138051.351783:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516288 00000100:00100000:2.0:1783138051.351851:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1783138051.351862:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:14393:x1869755299516288:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783138051.351883:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138051.351904:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a5f expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.351976:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b84d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.351990:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.352001:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138051.352116:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783138051.352121:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783138051.352158:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.352186:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a5f expref: 7 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.352206:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3c400/0x4691dfc3d66b84d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a5f expref: 6 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.352215:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:2.0:1783138051.352218:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138051.352222:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3c400, rc 0) 00000100:00100000:2.0:1783138051.352296:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:14393:x1869755299516288:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 436us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138051.352304:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1783138051.356119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.356271:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516416 00000100:00100000:3.0:1783138051.356283:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516416 00000100:00100000:3.0:1783138051.356353:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1783138051.356364:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:14393:x1869755299516416:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783138051.356387:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.356409:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b84db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a66 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356708:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356726:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356739:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356758:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356764:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.356792:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357456:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357467:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357475:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.357523:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783138051.357527:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138051.357803:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357818:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357825:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357832:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.357837:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.357842:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358092:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358179:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:3.0:1783138051.358182:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.358188:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358195:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b84e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358214:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358220:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358226:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358232:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.358235:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358240:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358249:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e5dcc955f00) 00010000:00010000:3.0:1783138051.358251:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.358253:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358258:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b84e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.358316:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b84db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a66 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.359118:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a66 expref: 7 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.359129:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:3.0:1783138051.359131:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138051.359134:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7600, rc 0) 00000100:00100000:3.0:1783138051.359301:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+7:14393:x1869755299516416:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2936us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.359311:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:1.0:1783138051.371379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.372225:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516672 00000100:00100000:2.0:1783138051.372243:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516672 00000100:00100000:2.0:1783138051.372334:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:2.0:1783138051.372347:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+7:14393:x1869755299516672:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783138051.372372:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138051.372397:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a6d expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138051.372540:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783138051.372749:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a6d expref: 9 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.372787:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:2.0:1783138051.372791:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138051.372797:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b84f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a6d expref: 9 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.372813:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3dc00, rc 0) 00000100:00100000:2.0:1783138051.372890:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+8:14393:x1869755299516672:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 546us (1531us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783138051.372898:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:1.0:1783138051.383904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.384067:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299516928 00000100:00100000:2.0:1783138051.384079:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299516928 00000100:00100000:2.0:1783138051.384142:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1783138051.384153:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+8:14393:x1869755299516928:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:2.0:1783138051.384216:0:16140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138051.384245:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b84f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a66 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.384267:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:2.0:1783138051.384280:0:16140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783138051.384308:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.384321:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.384331:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783138051.385252:0:16140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000805362ed reply state 00000000147e428d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.385265:0:16140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783138051.385285:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1783138051.385383:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+9:14393:x1869755299516928:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 1229us (1487us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783138051.385392:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1783138051.388830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1783138051.388847:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.388861:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.388870:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.388895:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138051.388900:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.388908:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.388928:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299517184 00010000:00010000:1.0:1783138051.388929:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5de2d1c200) 00010000:00010000:1.0:1783138051.388931:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783138051.388936:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.388938:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299517184 00010000:00010000:1.0:1783138051.388942:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b8505 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.388986:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:2.0:1783138051.388996:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+8:14393:x1869755299517184:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783138051.389279:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+9:14393:x1869755299517184:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 283us (460us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783138051.396350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.396507:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299517440 00000100:00100000:3.0:1783138051.396519:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299517440 00000100:00100000:2.0:1783138051.397235:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:3.0:1783138051.401418:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1783138051.401448:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+9:14393:x1869755299517440:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783138051.401478:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.401500:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b850c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a74 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401617:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401631:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401662:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401679:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401686:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401692:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.401836:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783138051.401940:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401949:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401956:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401962:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.401966:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401974:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.401986:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:3.0:1783138051.401989:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.402001:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402019:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402037:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402044:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402050:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402055:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.402059:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402065:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402073:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e5dcc955f00) 00010000:00010000:3.0:1783138051.402075:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.402078:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402084:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b851a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402135:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b850c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a74 expref: 11 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402156:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:3.0:1783138051.402158:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783138051.402163:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b850c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a74 expref: 11 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.402173:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6000, rc 0) 00000100:00100000:3.0:1783138051.402255:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+10:14393:x1869755299517440:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 823us (5916us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1783138051.402263:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:0.0:1783138051.409630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.409832:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299517568 00000100:00100000:3.0:1783138051.409843:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299517568 00000100:00100000:3.0:1783138051.409905:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:3.0:1783138051.409917:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+10:14393:x1869755299517568:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783138051.409944:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.409970:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8528 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a7b expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410201:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410217:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410229:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.410281:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783138051.410297:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138051.410326:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410355:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8528 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410374:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.410383:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:3.0:1783138051.410386:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138051.410389:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7a00, rc 0) 00000100:00100000:3.0:1783138051.410509:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+11:14393:x1869755299517568:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 594us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.410517:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:0.0:1783138051.425209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138051.425432:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299517696 00000100:00100000:1.0:1783138051.425444:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299517696 00000100:00100000:1.0:1783138051.425510:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1783138051.425522:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+11:14393:x1869755299517696:12345-192.168.202.24@tcp:37:lfs.0 00000100:00100000:0.0:1783138051.440419:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+11:14393:x1869755299517696:12345-192.168.202.24@tcp:37:lfs.0 Request processed in 14887us (15207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138051.440441:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:0.0:1783138051.458839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.458937:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299517952 00000100:00100000:2.0:1783138051.458948:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299517952 00000100:00100000:2.0:1783138051.459029:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:2.0:1783138051.459041:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd033c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+11:14393:x1869755299517952:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783138051.459734:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd033c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+12:14393:x1869755299517952:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 692us (902us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783138051.459745:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:0.0:1783138051.533825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138051.533925:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299518080 00000100:00100000:1.0:1783138051.533936:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299518080 00000100:00100000:1.0:1783138051.533996:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1783138051.534006:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+10:14399:x1869755299518080:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:1.0:1783138051.534039:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138051.534059:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1400/0x4691dfc3d66b8536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a82 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534513:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534530:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534578:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534595:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534602:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534609:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534724:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1200/0x4691dfc3d66b854b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534733:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1200/0x4691dfc3d66b854b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534739:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1200/0x4691dfc3d66b854b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138051.534771:0:14209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783138051.534775:0:14209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783138051.534817:0:14209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1200/0x4691dfc3d66b854b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534841:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534849:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534856:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534861:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138051.534866:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534872:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534886:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:1.0:1783138051.534888:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138051.534892:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534897:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1a00/0x4691dfc3d66b853d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534910:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534915:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534920:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534930:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138051.534933:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534939:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534947:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e5dcc8ef800) 00010000:00010000:1.0:1783138051.534949:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138051.534952:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534957:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0000/0x4691dfc3d66b8544 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.534990:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1400/0x4691dfc3d66b8536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a82 expref: 12 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.535004:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1200/0x4691dfc3d66b854b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a82 expref: 11 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138051.535507:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:1.0:1783138051.535510:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783138051.535513:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a1200, rc 0) 00000100:00100000:1.0:1783138051.536237:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+11:14399:x1869755299518080:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1774us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138051.536321:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1783138051.541515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.541653:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299518336 00000100:00100000:3.0:1783138051.541664:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299518336 00000100:00100000:3.0:1783138051.541723:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:3.0:1783138051.541732:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+11:14399:x1869755299518336:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783138051.541759:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.541782:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8552 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a89 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.541958:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.541973:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.541990:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.542091:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.542117:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 11 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138051.542133:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14207:1869755322580864:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783138051.542327:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd092e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138051.545539:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14207:1869755322580864:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138051.545727:0:14207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138051.546491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.546799:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299518464 00000100:00100000:2.0:1783138051.546809:0:16230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299518464 00010000:00010000:2.0:1783138051.546858:0:16230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 12 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.546931:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783138051.546942:0:16230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+12:2353:x1869755299518464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138051.546963:0:16230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138051.546971:0:16230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 12 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.546984:0:16230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 12 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.547023:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7a00/0x4691dfc3d66b852f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a7b expref: 12 pid: 14207 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.547043:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:2.0:1783138051.547049:0:16230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.547061:0:16230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.547069:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.547101:0:16230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138051.547183:0:16230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+11:2353:x1869755299518464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 242us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138051.547192:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00010000:00010000:3.0:1783138051.547306:0:14207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.547315:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.547345:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.547356:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.547365:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548422:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548438:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548447:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.548459:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138051.548495:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548502:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548509:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548515:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.548520:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548528:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548539:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:3.0:1783138051.548542:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.548578:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548596:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b8559 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783138051.548615:0:14207:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f95513b3 reply state 000000000b4ec955 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138051.548623:0:14207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783138051.548661:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8552 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548672:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 13 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.548678:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138051.548679:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1783138051.548681:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7c00, rc 0) 00000100:00100000:3.0:1783138051.548729:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+14:14399:x1869755299518336:12345-192.168.202.24@tcp:101:bash.0 Request processed in 6998us (7228us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1783138051.548736:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00010000:00010000:3.0:1783138051.551066:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551088:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551097:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551112:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138051.551133:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551142:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551160:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e5dcc955f00) 00010000:00010000:3.0:1783138051.551163:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138051.551167:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.551173:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8560 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138051.561422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138051.561680:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299518592 00000100:00100000:0.0:1783138051.561693:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299518592 00000100:00100000:0.0:1783138051.561760:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:0.0:1783138051.561771:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+13:14399:x1869755299518592:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783138051.561805:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138051.561854:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b8575 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a90 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.561949:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.561967:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.561982:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138051.562048:0:14209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783138051.562053:0:14209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783138051.562082:0:14209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.562095:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.562277:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b8575 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a90 expref: 15 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.562301:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a90 expref: 14 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138051.562309:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:0.0:1783138051.562313:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783138051.562317:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9200, rc 0) 00000100:00100000:0.0:1783138051.562509:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+14:14399:x1869755299518592:12345-192.168.202.24@tcp:101:bash.0 Request processed in 738us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138051.562527:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:2.0:1783138051.569402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.569529:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299518848 00000100:00100000:3.0:1783138051.569796:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299518848 00000100:00100000:2.0:1783138051.570069:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:2.0:1783138051.570082:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+14:14399:x1869755299518848:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:2.0:1783138051.570617:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+15:14399:x1869755299518848:12345-192.168.202.24@tcp:35:bash.0 Request processed in 534us (1230us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783138051.570627:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00010000:00010000:2.0:1783138051.644667:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138051.717268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.719256:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299519104 00000100:00100000:2.0:1783138051.719273:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299519104 00000100:00100000:2.0:1783138051.719364:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1783138051.719389:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+15:14409:x1869755299519104:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1783138051.719418:0:16140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138051.719440:0:16140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a97 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138051.719642:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783138051.719777:0:16140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8583 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a97 expref: 17 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.719792:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:2.0:1783138051.719796:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138051.719802:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a97 expref: 17 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.719820:0:16140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3cc00, rc 0) 00000100:00100000:2.0:1783138051.719889:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+16:14409:x1869755299519104:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 516us (2631us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783138051.719897:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:1.0:1783138051.723974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138051.724602:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299519360 00000100:00100000:0.0:1783138051.724614:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299519360 00000100:00100000:0.0:1783138051.724675:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1783138051.724685:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+16:14409:x1869755299519360:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783138051.724973:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+17:14409:x1869755299519360:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 289us (1009us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1783138051.724981:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1783138051.770916:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138051.770944:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322580992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138051.771053:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138051.771273:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322580992 00000100:00100000:0.0:1783138051.771282:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322580992 00000100:00100000:0.0:1783138051.771362:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138051.771372:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322580992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783138051.771422:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783138051.771479:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869755322580992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138051.771487:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138051.771595:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322580992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783138051.771803:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138051.785203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138051.785296:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299519616 00000100:00100000:3.0:1783138051.785308:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299519616 00000100:00100000:3.0:1783138051.785390:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:3.0:1783138051.785403:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+17:14412:x1869755299519616:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783138051.785429:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138051.785450:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8591 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922a9e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.785658:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8598 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.785681:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8598 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.785693:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8598 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138051.785707:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138051.785845:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8591 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a9e expref: 20 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.785868:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8598 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a9e expref: 19 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.785876:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138051.785879:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138051.785883:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7600, rc 0) 00000100:00100000:3.0:1783138051.785948:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+19:14412:x1869755299519616:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 548us (756us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783138051.785956:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1783138051.789404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138051.789450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138051.789537:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299519744 00000100:00100000:2.0:1783138051.789569:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299519744 00000100:00100000:2.0:1783138051.789631:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:2.0:1783138051.789641:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+19:14412:x1869755299519744:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1783138051.789712:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789730:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789741:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789769:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789777:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789784:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789790:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3cc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138051.789795:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789802:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789813:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138051.789816:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138051.789832:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138051.789839:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138051.789918:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+19:14412:x1869755299519744:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 277us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138051.789926:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:3.0:1783138051.790167:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299519872 00000100:00100000:3.0:1783138051.790172:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299519872 00000100:00100000:3.0:1783138051.790259:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783138051.790266:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+19:2353:x1869755299519872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138051.790279:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138051.790296:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8598 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a9e expref: 19 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138051.790320:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138051.790324:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138051.790348:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+18:2353:x1869755299519872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138051.790354:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1783138051.805735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138051.805966:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299520128 00000100:00100000:0.0:1783138051.805985:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299520128 00000100:00100000:0.0:1783138051.806075:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1783138051.806086:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+18:14412:x1869755299520128:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1783138051.806410:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+19:14412:x1869755299520128:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 323us (692us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783138051.806418:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000040:00080000:1.0:1783138052.027380:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783138052.145822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138052.145974:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299520384 00000100:00100000:3.0:1783138052.145986:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299520384 00000100:00100000:3.0:1783138052.146080:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1783138052.146093:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+19:14443:x1869755299520384:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:3.0:1783138052.146118:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138052.146137:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b85ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922aa5 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.146240:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b85b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.146258:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.146272:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138052.146284:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:1.0:1783138052.146532:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783138052.146790:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b85ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aa5 expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.146809:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b85b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aa5 expref: 21 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.146832:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138052.146835:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138052.146838:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6400, rc 0) 00000100:00100000:3.0:1783138052.146939:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+21:14443:x1869755299520384:12345-192.168.202.24@tcp:101:cat.0 Request processed in 849us (1130us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783138052.146946:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1783138052.166454:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138052.166604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138052.166832:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299520768 00000100:00100000:3.0:1783138052.166845:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299520768 00000100:00100000:3.0:1783138052.166920:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1783138052.166931:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:723ac79c-2210-42e9-aee9-241993d2ed66+21:2353:x1869755299520768:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138052.166950:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138052.166980:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b85b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aa5 expref: 21 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.167016:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138052.167022:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138052.167092:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:723ac79c-2210-42e9-aee9-241993d2ed66+20:2353:x1869755299520768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 162us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138052.167100:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:0.0:1783138052.172696:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299520640 00000100:00100000:0.0:1783138052.172711:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299520640 00000100:00100000:0.0:1783138052.172786:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1783138052.172798:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+20:14443:x1869755299520640:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1783138052.177034:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+21:14443:x1869755299520640:12345-192.168.202.24@tcp:35:cat.0 Request processed in 4224us (10579us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783138052.177050:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:1.0:1783138052.292871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138052.292928:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299521024 00000100:00100000:1.0:1783138052.292942:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299521024 00000100:00100000:1.0:1783138052.293013:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:1.0:1783138052.293029:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+21:14449:x1869755299521024:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1783138052.293063:0:16140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138052.293143:0:16140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b85c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922aac expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138052.293270:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b85c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138052.293286:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138052.293297:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138052.293323:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783138052.293535:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b85c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aac expref: 24 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138052.293579:0:16140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b85c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aac expref: 23 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138052.293589:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:1.0:1783138052.293592:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783138052.293596:0:16140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0400, rc 0) 00000100:00100000:1.0:1783138052.295038:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+23:14449:x1869755299521024:12345-192.168.202.24@tcp:101:dd.0 Request processed in 2004us (2172us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1783138052.295460:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:1.0:1783138052.314978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138052.315039:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299521280 00000100:00100000:1.0:1783138052.315050:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299521280 00000100:00100000:0.0:1783138052.315178:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:0.0:1783138052.315189:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+23:14449:x1869755299521280:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:0.0:1783138052.315250:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783138052.315280:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b85c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aac expref: 23 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.315302:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b857c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a90 expref: 22 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.315314:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:0.0:1783138052.315320:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783138052.315636:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.315651:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.315662:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783138052.315715:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783138052.315767:0:14209:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b00f3fc6 reply state 00000000865dd279 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138052.315777:0:14209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783138052.315869:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+24:14449:x1869755299521280:12345-192.168.202.24@tcp:36:dd.0 Request processed in 681us (899us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783138052.315877:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000020:00080000:0.0:1783138052.315883:0:14209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783138052.319237:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319254:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319262:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319278:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138052.319283:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319291:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319307:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138052.319310:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138052.319314:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.319320:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b85d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783138052.373441:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:0.0:1783138052.373495:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1783138052.435667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138052.435909:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299521536 00000100:00100000:2.0:1783138052.435922:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299521536 00000100:00100000:2.0:1783138052.435985:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:2.0:1783138052.435997:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+13:14449:x1869755299521536:12345-192.168.202.24@tcp:35:dd.0 00000100:00100000:2.0:1783138052.436276:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+14:14449:x1869755299521536:12345-192.168.202.24@tcp:35:dd.0 Request processed in 280us (617us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1783138052.436286:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00010000:00010000:0.0:1783138052.666802:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138052.670975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138052.671111:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299521664 00000100:00100000:2.0:1783138052.671122:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299521664 00000100:00100000:2.0:1783138052.671186:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:2.0:1783138052.671196:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+14:14463:x1869755299521664:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:2.0:1783138052.671446:0:16140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138052.671468:0:16140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922ab3 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671535:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671575:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671604:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671620:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671628:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671634:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.671990:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672014:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672022:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138052.672061:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783138052.672065:0:16140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783138052.672101:0:16140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672127:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672136:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672153:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672159:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672165:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138052.672170:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672177:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672190:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:2.0:1783138052.672193:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138052.672197:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672203:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b85e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672435:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672444:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672450:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672455:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138052.672464:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672472:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672481:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e5de2d1c600) 00010000:00010000:2.0:1783138052.672484:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138052.672487:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672494:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b85ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672531:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b85de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ab3 expref: 16 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672659:0:16140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ab3 expref: 15 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138052.672668:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138052.672671:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783138052.672674:0:16140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3dc00, rc 0) 00000100:00100000:2.0:1783138052.672751:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+15:14463:x1869755299521664:12345-192.168.202.24@tcp:101:stat.0 Request processed in 1557us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138052.672760:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:1.0:1783138052.743874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138052.743986:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299521920 00000100:00100000:0.0:1783138052.744028:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299521920 00000100:00100000:0.0:1783138052.744095:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:0.0:1783138052.744115:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+15:14469:x1869755299521920:12345-192.168.202.24@tcp:36:truncate.0 00010000:00010000:0.0:1783138052.744172:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138052.744200:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b85f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ab3 expref: 15 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.744231:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:0.0:1783138052.744237:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783138052.744804:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.744822:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138052.744833:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783138052.744913:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1783138052.744943:0:14209:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006105547a reply state 000000004c0b26c0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138052.744953:0:14209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783138052.745085:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+17:14469:x1869755299521920:12345-192.168.202.24@tcp:36:truncate.0 Request processed in 970us (1222us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783138052.745653:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000020:00080000:0.0:1783138052.745661:0:14209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783138052.753935:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.753953:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.753961:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.753967:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9200 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138052.753972:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.753979:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.754027:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138052.754030:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138052.754035:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.754042:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b85fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138052.801023:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138052.801050:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322581120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138052.801123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138052.801508:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581120 00000100:00100000:0.0:1783138052.801520:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581120 00000100:00100000:0.0:1783138052.801638:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138052.801651:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322581120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783138052.801740:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783138052.801861:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322581120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138052.801871:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138052.801939:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322581120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783138052.802016:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138052.802518:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322581376:0@lo:400:kworker.0 00000100:00100000:0.0:1783138052.802621:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138052.802654:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783138052.802661:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322581248:0@lo:400:kworker.0 00000100:00100000:0.0:1783138052.802694:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138052.802721:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322581760:0@lo:400:kworker.0 00000100:00100000:0.0:1783138052.802748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138052.802789:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581760 00000100:00100000:0.0:1783138052.802796:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581760 00000100:00100000:0.0:1783138052.802850:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783138052.802859:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322581760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138052.802927:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869755322581760:12345-0@lo:400:kworker.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138052.802935:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783138052.802971:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869755322581760:0@lo:400:kworker.0 00000100:00100000:2.0:1783138052.803505:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581248 00000100:00100000:2.0:1783138052.803511:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581248 00000100:00100000:2.0:1783138052.803579:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783138052.803588:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322581248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138052.803644:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3315:x1869755322581248:12345-0@lo:400:kworker.0 Request processed in 57us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138052.803651:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1783138052.803680:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138052.803838:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581376 00000100:00100000:3.0:1783138052.803844:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581376 00000100:00100000:3.0:1783138052.803883:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783138052.803891:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322581376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138052.803933:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322581376:12345-0@lo:400:kworker.0 Request processed in 43us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138052.803940:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138052.804150:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322581632:0@lo:400:kworker.0 00000100:00100000:1.0:1783138052.804189:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138052.804215:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138052.804234:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322581504:0@lo:400:kworker.0 00000100:00100000:1.0:1783138052.804260:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138052.804447:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581632 00000100:00100000:3.0:1783138052.804452:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581632 00000100:00100000:3.0:1783138052.804484:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322581504 00000100:00100000:3.0:1783138052.804487:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322581504 00000100:00100000:3.0:1783138052.804517:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138052.804524:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322581632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138052.804605:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322581632:12345-0@lo:400:kworker.0 Request processed in 69us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138052.804613:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138052.804632:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783138052.804639:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322581504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138052.804670:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322581504:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138052.804687:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783138052.804723:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322581504:0@lo:400:kworker.0 00000100:00100000:3.0:1783138052.804734:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322581632:0@lo:400:kworker.0 00000100:00080000:2.0:1783138052.805820:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138052.806015:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3315:1869755322581248:0@lo:400:kworker.0 00000100:00100000:0.0:1783138052.806038:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322581376:0@lo:400:kworker.0 00000100:00100000:1.0:1783138052.968348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138052.968484:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299522048 00000100:00100000:3.0:1783138052.968586:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299522048 00000100:00100000:3.0:1783138052.968719:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1783138052.968784:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+16:14483:x1869755299522048:12345-192.168.202.24@tcp:101:stat.0 00010000:00010000:3.0:1783138052.968822:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138052.974683:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8601 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922aba expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.974800:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.974819:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.974833:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.975211:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.975219:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.975227:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976039:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976062:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976070:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138052.976123:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1783138052.976135:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138052.976163:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976175:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976185:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976192:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976199:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976205:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a7600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138052.976209:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976217:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976238:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:3.0:1783138052.976241:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138052.976245:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976252:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8608 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976266:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976271:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976277:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976283:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138052.976286:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976292:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976298:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e5dca4bcc00) 00010000:00010000:3.0:1783138052.976300:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138052.976302:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976307:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b860f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976361:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8601 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 18 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976376:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 17 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138052.976384:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138052.976386:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138052.976388:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6a00, rc 0) 00000100:00100000:3.0:1783138052.977315:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+17:14483:x1869755299522048:12345-192.168.202.24@tcp:101:stat.0 Request processed in 8577us (8974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138052.977328:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:1.0:1783138053.053874:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138053.054578:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299522304 00000100:00100000:0.0:1783138053.054590:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299522304 00000100:00100000:0.0:1783138053.054670:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:0.0:1783138053.054681:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+17:14493:x1869755299522304:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1783138053.054707:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138053.054863:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b861d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922ac1 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138053.056369:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783138053.058020:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b861d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac1 expref: 19 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.058042:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:0.0:1783138053.058045:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783138053.058052:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b861d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac1 expref: 19 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.058072:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9200, rc 0) 00000100:00100000:0.0:1783138053.058173:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+18:14493:x1869755299522304:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 3493us (4314us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1783138053.058195:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:1.0:1783138053.061307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.063744:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299522560 00000100:00100000:2.0:1783138053.063766:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299522560 00000100:00100000:2.0:1783138053.063852:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1783138053.063862:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc2a58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+18:14493:x1869755299522560:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783138053.064446:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc2a58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+19:14493:x1869755299522560:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 583us (3154us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783138053.064455:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1783138053.124616:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.124959:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299522816 00000100:00100000:2.0:1783138053.124970:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299522816 00000100:00100000:2.0:1783138053.125142:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1783138053.125151:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+19:14499:x1869755299522816:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783138053.125179:0:16140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138053.125202:0:16140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b862b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922ac8 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126789:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126844:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126855:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 20 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126865:0:16140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126925:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 20 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.126944:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 20 pid: 14208 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138053.126960:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16140:1869755322581888:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783138053.127119:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.127128:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138053.127137:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5df5abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16140:1869755322582016:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783138053.127162:0:16140:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd9c01b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138053.132936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138053.133090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.133193:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16140:1869755322581888:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783138053.133206:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5df5abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16140:1869755322582016:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783138053.133251:0:16140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138053.134294:0:16231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299522944 00000100:00100000:0.0:1783138053.134308:0:16231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299522944 00010000:00010000:0.0:1783138053.134367:0:16231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 21 pid: 14208 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138053.134452:0:16231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523072 00000100:00100000:0.0:1783138053.134457:0:16231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523072 00010000:00010000:0.0:1783138053.134472:0:16231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 22 pid: 14207 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138053.134598:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1783138053.134629:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01141050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+22:2353:x1869755299522944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138053.134648:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138053.134658:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 22 pid: 14208 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.134672:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 22 pid: 14208 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.134706:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8616 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aba expref: 22 pid: 14208 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.134729:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138053.134751:0:14192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.134761:0:14192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.134768:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138053.134857:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01141050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+21:2353:x1869755299522944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 233us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138053.134866:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1783138053.135673:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1783138053.135682:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+20:2353:x1869755299523072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138053.135691:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138053.135703:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135718:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135735:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8567 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922a89 expref: 20 pid: 14207 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135749:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138053.135754:0:14192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135762:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135786:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.135985:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138053.136032:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+19:2353:x1869755299523072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 351us (2942us total) trans 0 rc 0/0 00010000:00010000:2.0:1783138053.136159:0:16140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.136167:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138053.136193:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1783138053.136414:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b862b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 21 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.136435:0:16140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 20 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.136444:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138053.136447:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783138053.136450:0:16140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3de00, rc 0) 00000100:00100000:2.0:1783138053.136496:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+20:14499:x1869755299522816:12345-192.168.202.24@tcp:101:bash.0 Request processed in 11345us (11897us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1783138053.136503:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:3.0:1783138053.137421:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1783138053.143277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.143368:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523328 00000100:00100000:2.0:1783138053.143380:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523328 00000100:00100000:2.0:1783138053.143517:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1783138053.143529:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+19:14499:x1869755299523328:12345-192.168.202.24@tcp:36:bash.0 00010000:00010000:2.0:1783138053.144523:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.145246:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.145263:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783138053.145356:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1783138053.145474:0:14209:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d231cacb reply state 000000002e85dcb6 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138053.145487:0:14209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783138053.145646:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299523328:12345-192.168.202.24@tcp:36:bash.0 Request processed in 2114us (2381us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1783138053.145657:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000020:00080000:2.0:1783138053.145664:0:14209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783138053.148199:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148225:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148234:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148242:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138053.148248:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148257:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148278:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138053.148281:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138053.148286:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.148293:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b8640 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138053.150934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138053.151306:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523456 00000100:00100000:3.0:1783138053.151320:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523456 00000100:00100000:3.0:1783138053.151520:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:3.0:1783138053.151538:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+21:14499:x1869755299523456:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783138053.151712:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138053.151740:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8647 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922acf expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.151961:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8647 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922acf expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.151981:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8647 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922acf expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138053.152016:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:3.0:1783138053.152021:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138053.152025:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7c00, rc 0) 00000100:00100000:3.0:1783138053.152279:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299523456:12345-192.168.202.24@tcp:101:bash.0 Request processed in 744us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138053.152288:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:1.0:1783138053.161630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138053.161871:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523584 00000100:00100000:0.0:1783138053.161938:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523584 00000100:00100000:0.0:1783138053.162022:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:0.0:1783138053.162033:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299523584:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1783138053.162174:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138053.162203:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b864e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922ad6 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.162313:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.162331:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 23 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.162340:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.162381:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 23 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.162990:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 23 pid: 16140 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138053.163018:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14207:1869755322582144:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783138053.163714:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd09bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138053.171771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.171863:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523712 00000100:00100000:2.0:1783138053.171876:0:16230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523712 00010000:00010000:2.0:1783138053.171940:0:16230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 24 pid: 16140 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138053.172111:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14207:1869755322582144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783138053.172141:0:14207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138053.172357:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1783138053.172373:0:16230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:723ac79c-2210-42e9-aee9-241993d2ed66+24:2352:x1869755299523712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138053.172395:0:16230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138053.172416:0:16230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 24 pid: 16140 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172431:0:16230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 24 pid: 16140 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172482:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b8632 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ac8 expref: 24 pid: 16140 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172500:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:2.0:1783138053.172506:0:16230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172517:0:16230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172525:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.172893:0:16230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138053.172965:0:16230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:723ac79c-2210-42e9-aee9-241993d2ed66+23:2352:x1869755299523712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 595us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138053.172976:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00010000:00010000:1.0:1783138053.173589:0:14207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138053.173602:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138053.173674:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783138053.173680:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783138053.173708:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138053.173753:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9200/0x4691dfc3d66b864e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ad6 expref: 23 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138053.173777:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ad6 expref: 22 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138053.173787:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:1.0:1783138053.173806:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783138053.173809:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9600, rc 0) 00000100:00100000:1.0:1783138053.173853:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299523584:12345-192.168.202.24@tcp:101:bash.0 Request processed in 11823us (12238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138053.173862:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:1.0:1783138053.177144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138053.179351:0:16231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299523968 00000100:00100000:0.0:1783138053.179369:0:16231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299523968 00000100:00100000:0.0:1783138053.179480:0:16231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:0.0:1783138053.179493:0:16231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299523968:12345-192.168.202.24@tcp:103:bash.0 00010000:00010000:0.0:1783138053.179515:0:16231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783138053.179735:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8655 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ad6 expref: 22 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.179767:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7c00/0x4691dfc3d66b8647 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922acf expref: 21 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138053.179782:0:16231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5dcc955c00) 00010000:00010000:0.0:1783138053.179797:0:16231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138053.180173:0:16231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:723ac79c-2210-42e9-aee9-241993d2ed66+20:14499:x1869755299523968:12345-192.168.202.24@tcp:103:bash.0 Request processed in 680us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138053.180183:0:16231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1783138053.187310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.187501:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524096 00000100:00100000:2.0:1783138053.187514:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524096 00000100:00100000:2.0:1783138053.187984:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:2.0:1783138053.188010:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+20:14499:x1869755299524096:12345-192.168.202.24@tcp:58:bash.0 00010000:00010000:2.0:1783138053.188326:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.188348:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.188362:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138053.190524:0:16140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138053.191064:0:16140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783138053.191294:0:16140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783138053.191630:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+20:14499:x1869755299524096:12345-192.168.202.24@tcp:58:bash.0 Request processed in 3626us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138053.191644:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:1.0:1783138053.194744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138053.194854:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524224 00000100:00100000:2.0:1783138053.194868:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524224 00000100:00100000:2.0:1783138053.194979:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:2.0:1783138053.194992:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+20:14499:x1869755299524224:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1783138053.195030:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138053.195058:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922add expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195148:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195161:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 21 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195183:0:14209:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195199:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 21 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195215:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:2.0:1783138053.195236:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783138053.195241:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 21 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138053.195250:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5df5e3cc00, rc 0) 00000100:00100000:2.0:1783138053.195338:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+21:14499:x1869755299524224:12345-192.168.202.24@tcp:101:bash.0 Request processed in 348us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138053.195347:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00010000:00010000:2.0:1783138053.693387:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783138054.074900:0:14239:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783138054.074914:0:14239:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783138054.075003:0:14239:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783138054.075012:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783138054.075393:0:14239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01430a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14239:1869755322582272:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783138054.077158:0:14239:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc67800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138054.081375:0:14239:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01430a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14239:1869755322582272:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783138054.082638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.084193:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524352 00000100:00100000:0.0:1783138054.084212:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524352 00000100:00080000:2.0:1783138054.084324:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138054.091159:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:0.0:1783138054.091195:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524352:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783138054.091333:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524352:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 Request processed in 158us (8705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138054.091341:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783138054.094095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138054.098019:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524480 00000100:00100000:2.0:1783138054.098041:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524480 00000100:00100000:2.0:1783138054.098190:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:2.0:1783138054.098202:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524480:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783138054.098247:0:14208:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783138054.098404:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524480:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 203us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138054.098413:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:1.0:1783138054.105790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.113280:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524608 00000100:00100000:0.0:1783138054.113303:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524608 00000100:00100000:0.0:1783138054.113404:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:0.0:1783138054.113416:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524608:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783138054.113512:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.113534:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.113569:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114145:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114170:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114202:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114235:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114244:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114251:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138054.114292:0:16140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783138054.114296:0:16140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783138054.114309:0:16140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114320:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114326:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114333:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114339:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.114343:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114350:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114369:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5dcc955500) 00010000:00010000:3.0:1783138054.114372:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.114377:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114384:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9a00/0x4691dfc3d66b866a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114403:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114409:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114414:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114419:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.114422:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114428:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114436:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e5dca4bcc00) 00010000:00010000:3.0:1783138054.114438:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.114440:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114446:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8671 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114475:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114481:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114487:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114491:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.114494:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114499:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114505:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:3.0:1783138054.114507:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.114511:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.114517:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b8678 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.114655:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524608:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 1237us (8878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.114666:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1783138054.116636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.116749:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524864 00000100:00100000:0.0:1783138054.116759:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524864 00000100:00100000:0.0:1783138054.116823:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1783138054.116834:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+21:14500:x1869755299524864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783138054.116855:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138054.116878:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b867f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922ae4 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117011:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117028:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117039:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138054.117049:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783138054.117355:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117364:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117372:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117377:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5e021d9600 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:0.0:1783138054.117381:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117388:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117402:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:0.0:1783138054.117404:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783138054.117409:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117425:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9600/0x4691dfc3d66b8686 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117474:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b867f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ae4 expref: 23 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117485:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e5dcc955500) 00010000:00010000:0.0:1783138054.117488:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783138054.117492:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b867f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922ae4 expref: 23 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.117502:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9400, rc 0) 00000100:00100000:0.0:1783138054.117678:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+22:14500:x1869755299524864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 845us (1051us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1783138054.117686:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1783138054.128526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.133499:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299524992 00000100:00100000:3.0:1783138054.133515:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299524992 00000100:00100000:3.0:1783138054.133613:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1783138054.133624:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+22:14500:x1869755299524992:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783138054.133661:0:16140:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783138054.133785:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+22:14500:x1869755299524992:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 163us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.133794:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:3.0:1783138054.139759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.139919:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299525248 00000100:00100000:1.0:1783138054.139932:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299525248 00000100:00100000:1.0:1783138054.140006:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1783138054.140017:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+22:14500:x1869755299525248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138054.140038:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138054.140058:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8694 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922aeb expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783138054.140886:0:14209:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1783138054.140895:0:14209:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1783138054.140940:0:14209:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1783138054.141264:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b869b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.141285:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b869b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.141296:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b869b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.141352:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8694 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aeb expref: 25 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.141368:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b869b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aeb expref: 24 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.141376:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef500) 00010000:00010000:1.0:1783138054.141379:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783138054.141383:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0c00, rc 0) 00000100:00100000:1.0:1783138054.141453:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+24:14500:x1869755299525248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1438us (1709us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783138054.141462:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1783138054.145796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.145900:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299525504 00000100:00100000:3.0:1783138054.145913:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299525504 00000100:00100000:3.0:1783138054.146007:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1783138054.146019:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+24:14500:x1869755299525504:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783138054.146254:0:16140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138054.146291:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b869b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922aeb expref: 24 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146316:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef500) 00010000:00010000:3.0:1783138054.146329:0:16140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783138054.146358:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146372:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146383:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146400:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146428:0:16140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.146436:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149287:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149311:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149320:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149327:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.149333:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149342:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149365:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:3.0:1783138054.149368:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.149374:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149380:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149400:0:16140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149424:0:16140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149429:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149433:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.149436:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149442:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149450:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfeab09b3 (ffff8e5dca4bcc00) 00010000:00010000:3.0:1783138054.149453:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.149456:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.149461:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b86b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfeab09b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.149659:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+23:14500:x1869755299525504:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 3635us (3872us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783138054.149668:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1783138054.157379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.157592:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299525632 00000100:00100000:1.0:1783138054.157605:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299525632 00000100:00100000:1.0:1783138054.157682:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1783138054.157693:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+23:14500:x1869755299525632:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138054.157720:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138054.157751:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b86b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922af2 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.157822:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b86be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.157838:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b86be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.157852:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b86be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.157976:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b86b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af2 expref: 25 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.158009:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0400/0x4691dfc3d66b86be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af2 expref: 24 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.158019:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:1.0:1783138054.158022:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783138054.158025:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a0400, rc 0) 00000100:00100000:1.0:1783138054.158124:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+24:14500:x1869755299525632:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 432us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.158135:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1783138054.162652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.162855:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299525888 00000100:00100000:0.0:1783138054.162872:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299525888 00000100:00100000:2.0:1783138054.163109:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:2.0:1783138054.163123:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+24:14500:x1869755299525888:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783138054.163208:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.163226:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.163238:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138054.163716:0:14208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1783138054.163727:0:14208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 544056181884ns, next at 545056179027ns, rc = 0 00000004:00010000:2.0:1783138054.163808:0:14208:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac6e1686 reply state 0000000088d9e884 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138054.163833:0:14208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783138054.163942:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+26:14500:x1869755299525888:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 820us (1305us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1783138054.163951:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00010000:00010000:2.0:1783138054.168861:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168880:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168888:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168895:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3ce00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138054.168900:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168907:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168926:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:2.0:1783138054.168929:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783138054.168933:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.168963:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3ce00/0x4691dfc3d66b86c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138054.170315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.170596:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526016 00000100:00100000:0.0:1783138054.170610:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526016 00000100:00100000:0.0:1783138054.170671:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1783138054.170681:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+25:14500:x1869755299526016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783138054.170718:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138054.170737:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922af9 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.170795:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 26 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.170840:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 26 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.170858:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:0.0:1783138054.170861:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783138054.170864:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9400, rc 0) 00000100:00100000:0.0:1783138054.170931:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+26:14500:x1869755299526016:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 251us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138054.170939:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:3.0:1783138054.177499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.177703:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526144 00000100:00100000:0.0:1783138054.177716:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526144 00000100:00080000:2.0:1783138054.177785:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138054.177810:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1783138054.177824:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+5:2352:x1869755299526144:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783138054.178383:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+6:2352:x1869755299526144:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 560us (897us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783138054.178393:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:3.0:1783138054.182353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.182480:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526400 00000100:00100000:0.0:1783138054.182492:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526400 00000100:00100000:0.0:1783138054.182616:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1783138054.182631:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+26:14500:x1869755299526400:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783138054.182966:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+27:14500:x1869755299526400:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 338us (629us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783138054.182975:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1783138054.185414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.185540:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526656 00000100:00100000:3.0:1783138054.185586:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526656 00000100:00100000:3.0:1783138054.185668:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1783138054.185678:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+27:14500:x1869755299526656:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783138054.185948:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:723ac79c-2210-42e9-aee9-241993d2ed66+27:14500:x1869755299526656:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 271us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.185956:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1783138054.189660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.199181:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526784 00000100:00100000:1.0:1783138054.199199:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526784 00000100:00100000:1.0:1783138054.199278:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1783138054.199291:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+27:14500:x1869755299526784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138054.199331:0:14209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138054.199354:0:14209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0800/0x4691dfc3d66b86d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922b00 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199444:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199459:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199471:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138054.199508:0:14209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783138054.199528:0:14209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199577:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0800/0x4691dfc3d66b86d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b00 expref: 29 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199598:0:14209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b00 expref: 28 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.199608:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:1.0:1783138054.199611:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783138054.199614:0:14209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5cc34a1c00, rc 0) 00000100:00100000:1.0:1783138054.199689:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+28:14500:x1869755299526784:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 400us (10038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.199697:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:1.0:1783138054.207799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.207894:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299526912 00000100:00100000:3.0:1783138054.207912:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299526912 00000100:00100000:3.0:1783138054.208001:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783138054.208014:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+6:2353:x1869755299526912:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138054.208048:0:14844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138054.208077:0:14844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922b07 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783138054.208122:0:14844:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a488705, blocks: 0x1 00010000:00010000:3.0:1783138054.208150:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1783138054.208156:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138054.208168:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 7 pid: 14844 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.208191:0:14844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 7 pid: 14844 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.208208:0:14844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6a00, rc 0) 00000100:00100000:3.0:1783138054.208291:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+7:2353:x1869755299526912:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 279us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.208325:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1783138054.219771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.222249:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527168 00000100:00100000:1.0:1783138054.222265:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527168 00000100:00100000:1.0:1783138054.222356:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1783138054.222369:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+28:14500:x1869755299527168:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783138054.222503:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+28:14500:x1869755299527168:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 136us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.222511:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1783138054.233884:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.234040:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527296 00000100:00100000:0.0:1783138054.234068:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527296 00000100:00100000:0.0:1783138054.234142:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1783138054.234153:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+28:14500:x1869755299527296:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783138054.425819:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1783138054.425921:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783138054.426160:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322582400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783138054.426254:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138054.426354:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322582400 00000100:00100000:0.0:1783138054.426364:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322582400 00000100:00100000:0.0:1783138054.426447:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138054.426458:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869755322582400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783138054.426711:0:14843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783138054.426716:0:14843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783138054.426718:0:14843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783138054.426721:0:14843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783138053 -> 1783138053 00002000:00010000:0.0:1783138054.426723:0:14843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783138054.426771:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5cc347dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869755322582400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 314us (518us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783138054.426780:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1783138054.426831:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e5cc347ed80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1783138054.426837:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5cc347ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322582400:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1783138054.426852:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783138054.427439:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+13:14500:x1869755299527296:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 193283us (193561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.427451:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:1.0:1783138054.438450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.442267:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527424 00000100:00100000:3.0:1783138054.442291:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527424 00000100:00100000:3.0:1783138054.442447:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1783138054.442461:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+7:2353:x1869755299527424:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783138054.442673:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+7:2353:x1869755299527424:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 214us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.442683:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:2.0:1783138054.457309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.457571:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527680 00000100:00100000:3.0:1783138054.457585:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527680 00000100:00100000:3.0:1783138054.457665:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:3.0:1783138054.457677:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+13:14500:x1869755299527680:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783138054.457754:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138054.457788:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1c00/0x4691dfc3d66b86da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b00 expref: 13 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.457811:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:3.0:1783138054.457816:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783138054.457853:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.457870:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.457880:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783138054.458293:0:14208:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007af3f252 reply state 00000000d7ffd571 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.458306:0:14208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783138054.458418:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+14:14500:x1869755299527680:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 742us (1123us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1783138054.458426:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00010000:00010000:3.0:1783138054.461260:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461280:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461288:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461296:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:3.0:1783138054.461301:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461310:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461332:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:3.0:1783138054.461335:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138054.461340:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.461346:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6400/0x4691dfc3d66b86e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138054.467002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.467123:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527808 00000100:00100000:0.0:1783138054.467136:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527808 00000100:00100000:0.0:1783138054.467210:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1783138054.467222:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+7:14500:x1869755299527808:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783138054.467267:0:14843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138054.467293:0:14843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922b0e expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.467333:0:14843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.467345:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138054.467351:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138054.467357:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 8 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.467401:0:14843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.467417:0:14843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138054.467434:0:14843:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14843:1869755322582528:192.168.202.24@tcp:104: 00000100:00100000:0.0:1783138054.467595:0:14843:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dfa181240 going to sleep for 11 seconds 00000100:00100000:0.0:1783138054.470647:0:14843:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14843:1869755322582528:192.168.202.24@tcp:104: 00010000:00010000:0.0:1783138054.470701:0:14843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 8 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138054.470730:0:14843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5e021d9200, rc 0) 00000100:00100000:0.0:1783138054.470832:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+8:14500:x1869755299527808:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 3612us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138054.470843:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1783138054.472179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.472461:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299527936 00000100:00100000:3.0:1783138054.472472:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299527936 00010000:00010000:3.0:1783138054.472522:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.472621:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783138054.472632:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+8:2352:x1869755299527936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138054.472650:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138054.472679:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.472694:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.472724:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000843ef922/0x4691dfc3d66b86e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b07 expref: 8 pid: 14844 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.472749:0:14192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138054.472754:0:14192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138054.472762:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 7 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.472773:0:14192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 7 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.472840:0:14192:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 7 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.472858:0:14192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14192:1869755322582656:192.168.202.24@tcp:105: 00000100:00100000:3.0:1783138054.473009:0:14192:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd092e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138054.491625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138054.493239:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528064 00000100:00100000:0.0:1783138054.493261:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528064 00000100:00100000:0.0:1783138054.493353:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783138054.493365:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+8:2353:x1869755299528064:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783138054.493678:0:14845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783138054.493683:0:14845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783138052 00002000:00010000:0.0:1783138054.493686:0:14845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783138050 00002000:00010000:0.0:1783138054.493688:0:14845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783138053 -> 1783138052 00002000:00010000:0.0:1783138054.493691:0:14845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783138054.493770:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+9:2353:x1869755299528064:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 407us (2161us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783138054.493779:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1783138054.497945:0:14192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14192:1869755322582656:192.168.202.24@tcp:105: 00010000:00010000:3.0:1783138054.497994:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138054.501468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.501690:0:16139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528192 00000100:00100000:3.0:1783138054.501703:0:16139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528192 00000100:00100000:3.0:1783138054.501764:0:16139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1783138054.501775:0:16139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:723ac79c-2210-42e9-aee9-241993d2ed66+9:2352:x1869755299528192:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783138054.501830:0:16139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.501854:0:16139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 9 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.501866:0:16139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138054.501871:0:16139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783138054.501876:0:16139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.501917:0:16139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 9 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.501959:0:16139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 9 pid: 14843 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.501977:0:16139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16139:1869755322582784:192.168.202.24@tcp:104: 00000100:00100000:3.0:1783138054.502102:0:16139:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd092e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138054.504441:0:16139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5c54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16139:1869755322582784:192.168.202.24@tcp:104: 00010000:00010000:3.0:1783138054.504479:0:16139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138054.506174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.506295:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528320 00000100:00100000:1.0:1783138054.506306:0:16230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528320 00010000:00010000:1.0:1783138054.506355:0:16230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 10 pid: 14843 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138054.506402:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:1.0:1783138054.506413:0:16230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:723ac79c-2210-42e9-aee9-241993d2ed66+10:2352:x1869755299528320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138054.506432:0:16230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138054.506462:0:16230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 10 pid: 14843 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.506478:0:16230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 10 pid: 14843 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.506524:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c31eaf52/0x4691dfc3d66b86ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b0e expref: 10 pid: 14843 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.506607:0:16230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783138054.506613:0:16230:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783138054.506620:0:16230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.506633:0:16230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.506682:0:16230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138054.506741:0:16230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:723ac79c-2210-42e9-aee9-241993d2ed66+9:2352:x1869755299528320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 329us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.506750:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00010000:00010000:3.0:1783138054.507092:0:16139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507105:0:16139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507140:0:16139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507150:0:16139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507160:0:16139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507183:0:16139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6400 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:3.0:1783138054.507188:0:16139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507199:0:16139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507213:0:16139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.507222:0:16139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b86f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.507284:0:16139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:723ac79c-2210-42e9-aee9-241993d2ed66+8:2352:x1869755299528192:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 5510us (5832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.507293:0:16139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1783138054.509662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.509888:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528576 00000100:00100000:3.0:1783138054.509899:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528576 00000100:00100000:3.0:1783138054.509973:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:3.0:1783138054.509993:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+13:14500:x1869755299528576:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783138054.510118:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.510141:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.510178:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.510497:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.510511:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.510521:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138054.511117:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:723ac79c-2210-42e9-aee9-241993d2ed66+7:2352:x1869755299527936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 38481us (38944us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138054.511131:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00010000:00010000:2.0:1783138054.512969:0:14209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.513008:0:14209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 14 pid: 14207 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138054.513030:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322582912:192.168.202.24@tcp:104: 00000100:00100000:2.0:1783138054.513757:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dd092e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138054.520909:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dd0b7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322582912:192.168.202.24@tcp:104: 00010000:00010000:2.0:1783138054.520955:0:14209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138054.528994:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.529199:0:16231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528704 00000100:00100000:3.0:1783138054.529212:0:16231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528704 00010000:00010000:3.0:1783138054.529267:0:16231:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 15 pid: 14207 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138054.529320:0:16231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:3.0:1783138054.529331:0:16231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:723ac79c-2210-42e9-aee9-241993d2ed66+15:2352:x1869755299528704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783138054.529349:0:16231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138054.529356:0:16231:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 15 pid: 14207 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529372:0:16231:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 15 pid: 14207 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529399:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5e021d9400/0x4691dfc3d66b86cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922af9 expref: 15 pid: 14207 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529445:0:16231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:3.0:1783138054.529452:0:16231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529464:0:16231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529474:0:16231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.529511:0:16231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783138054.529642:0:16231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:723ac79c-2210-42e9-aee9-241993d2ed66+14:2352:x1869755299528704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 312us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.529651:0:16231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00010000:00010000:1.0:1783138054.530454:0:14209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.530469:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783138054.530766:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1783138054.530967:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1783138054.531027:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1783138054.531317:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14209:1869755322583040:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783138054.531535:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138054.531655:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5df59b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783138054.532307:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583040 00000100:00100000:3.0:1783138054.532320:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583040 00000100:00100000:3.0:1783138054.532387:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138054.532397:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14209:x1869755322583040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783138054.532533:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14209:x1869755322583040:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.532541:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783138054.532642:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14209:1869755322583040:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783138054.534216:0:14209:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1783138054.534340:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14209:1869755322583168:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783138054.534411:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138054.534815:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583168 00000100:00100000:3.0:1783138054.534828:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583168 00000100:00100000:3.0:1783138054.535043:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138054.535056:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14209:x1869755322583168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783138054.535369:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783138054.535392:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14209:x1869755322583168:12345-0@lo:1000:mdt00_002.0 Request processed in 337us (978us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783138054.535413:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138054.535424:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14209:1869755322583168:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783138054.535477:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535491:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535499:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535506:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6a00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138054.535510:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535518:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535536:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:1.0:1783138054.535540:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783138054.535563:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535570:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6a00/0x4691dfc3d66b8704 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535629:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535636:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535642:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535667:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3de00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138054.535671:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535677:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535686:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:1.0:1783138054.535689:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783138054.535771:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 17 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535784:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 17 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535795:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 17 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.535869:0:14209:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3cc00/0x4691dfc3d66b8663 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922add expref: 17 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138054.536201:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e0140ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322583296:192.168.202.24@tcp:105: 00000100:00100000:1.0:1783138054.536295:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e5dc7e1b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138054.549040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138054.549893:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e0140ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14209:1869755322583296:192.168.202.24@tcp:105: 00010000:00010000:2.0:1783138054.549940:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.549971:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3de00/0x4691dfc3d66b865c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550016:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550030:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550041:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550053:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550060:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550067:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550073:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5df5e3dc00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138054.550078:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550085:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550097:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:2.0:1783138054.550100:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138054.550103:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550116:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5df5e3dc00/0x4691dfc3d66b870b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550127:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550134:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550140:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550145:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5dea3a6000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:2.0:1783138054.550148:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550153:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550162:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:2.0:1783138054.550164:0:14209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783138054.550166:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138054.550171:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a6000/0x4691dfc3d66b86fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138054.550453:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:723ac79c-2210-42e9-aee9-241993d2ed66+17:14500:x1869755299528576:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 40469us (40804us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1783138054.550464:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000020:00080000:2.0:1783138054.550477:0:14209:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783138054.553417:0:14239:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783138054.553432:0:14239:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783138054.553474:0:14239:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783138054.553481:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783138054.553811:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299528832 00000100:00100000:3.0:1783138054.553824:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299528832 00000100:00100000:3.0:1783138054.553909:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1783138054.553921:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+17:14499:x1869755299528832:12345-192.168.202.24@tcp:49:bash.0 00000100:00100000:1.0:1783138054.561861:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+17:14499:x1869755299528832:12345-192.168.202.24@tcp:49:bash.0 Request processed in 7921us (12815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.561882:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1783138054.564213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.564478:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299529088 00000100:00100000:1.0:1783138054.564491:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299529088 00000100:00100000:1.0:1783138054.564589:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1783138054.564600:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+17:14500:x1869755299529088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783138054.565441:0:14210:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783138054.565593:0:14210:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1783138054.565648:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565669:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565683:0:14210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565694:0:14210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565713:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565720:0:14210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.565745:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783138054.565855:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+19:14500:x1869755299529088:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 1253us (1653us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1783138054.565865:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000020:00080000:1.0:1783138054.565871:0:14210:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783138054.567243:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138054.567259:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.567272:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1000 already unused, calling callback (ffffffffc17adce0) 00010000:00010000:1.0:1783138054.567277:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.567287:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.567308:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e5dcc8ef800) 00010000:00010000:1.0:1783138054.567312:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783138054.567317:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.567324:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b8712 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.567363:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138054.567366:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138054.567369:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138054.569163:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.569282:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299529216 00000100:00100000:3.0:1783138054.569298:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299529216 00000100:00100000:3.0:1783138054.569368:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1783138054.569381:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+7:14499:x1869755299529216:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1783138054.569403:0:14845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138054.569427:0:14845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b8719 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922b15 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783138054.569457:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a488704, atime: 0x6a488702, ctime: 0x6a488704, blocks: 0x1 00010000:00010000:3.0:1783138054.569481:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1783138054.569486:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138054.569498:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b8719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b15 expref: 8 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.569516:0:14845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098a9d3bf/0x4691dfc3d66b8719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b15 expref: 8 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.569530:0:14845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a6400, rc 0) 00000100:00100000:3.0:1783138054.569632:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:723ac79c-2210-42e9-aee9-241993d2ed66+8:14499:x1869755299529216:12345-192.168.202.24@tcp:101:bash.0 Request processed in 254us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138054.569675:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1783138054.576059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.576133:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299529472 00000100:00100000:3.0:1783138054.576150:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299529472 00000100:00100000:3.0:1783138054.576221:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1783138054.576235:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+19:14499:x1869755299529472:12345-192.168.202.24@tcp:35:bash.0 00000001:00080000:3.0:1783138054.576507:0:14210:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1783138054.576665:0:14210:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1783138054.577037:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:723ac79c-2210-42e9-aee9-241993d2ed66+22:14499:x1869755299529472:12345-192.168.202.24@tcp:35:bash.0 Request processed in 804us (992us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1783138054.577047:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000020:00080000:3.0:1783138054.577054:0:14210:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1783138054.721420:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138054.751822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138054.752044:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299529728 00000100:00100000:3.0:1783138054.752054:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299529728 00000100:00100000:3.0:1783138054.752123:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:3.0:1783138054.752134:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+22:14510:x1869755299529728:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1783138054.752165:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138054.752190:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6a505f23922b1c expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138054.752490:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783138054.752724:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8720 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b1c expref: 24 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.752739:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e5dcc955800) 00010000:00010000:3.0:1783138054.752742:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783138054.752748:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5dea3a7600/0x4691dfc3d66b8720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x5b6a505f23922b1c expref: 24 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138054.752774:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e5dea3a7600, rc 0) 00000100:00100000:3.0:1783138054.752849:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e0140b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:723ac79c-2210-42e9-aee9-241993d2ed66+23:14510:x1869755299529728:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 716us (1040us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1783138054.752857:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1783138054.756248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138054.756356:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299529856 00000100:00100000:1.0:1783138054.756367:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299529856 00000100:00100000:1.0:1783138054.756432:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:1.0:1783138054.756443:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+23:14510:x1869755299529856:12345-192.168.202.24@tcp:34:lfs.0 00010000:00010000:1.0:1783138054.756530:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.756596:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.756609:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.756636:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.756643:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.757092:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.757440:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758059:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758068:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783138054.758129:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758145:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758151:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758158:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758164:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1000 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138054.758168:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758176:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758188:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e5dcc955400) 00010000:00010000:1.0:1783138054.758191:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138054.758197:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758203:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1000/0x4691dfc3d66b872e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758227:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758233:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758239:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758244:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a1800 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138054.758247:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758253:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758261:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e5dcc8efd00) 00010000:00010000:1.0:1783138054.758264:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138054.758267:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758273:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a1800/0x4691dfc3d66b8735 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758290:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758297:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758303:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758315:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e5cc34a0c00 already unused, calling callback (ffffffffc21e94f0) 00010000:00010000:1.0:1783138054.758318:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758324:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758333:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e5de2d1c600) 00010000:00010000:1.0:1783138054.758335:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138054.758338:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138054.758344:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e5cc34a0c00/0x4691dfc3d66b873c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138054.758459:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5df5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+23:14510:x1869755299529856:12345-192.168.202.24@tcp:34:lfs.0 Request processed in 2012us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138054.758471:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1783138054.770146:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1783138054.770247:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530112 00000100:00100000:2.0:1783138054.770259:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530112 00000100:00100000:2.0:1783138054.770322:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:2.0:1783138054.770334:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+23:14510:x1869755299530112:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1783138054.771125:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:723ac79c-2210-42e9-aee9-241993d2ed66+24:14510:x1869755299530112:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 788us (985us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1783138054.771135:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:3.0:1783138055.264792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138055.264849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138055.264967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138055.265020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138055.265103:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530240 00000100:00100000:0.0:1783138055.265116:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530240 00000100:00100000:0.0:1783138055.265174:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:0.0:1783138055.265184:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2350:x1869755299530240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138055.265273:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d431c32a-1317-4a85-9afc-df1a48112b4b+13:2350:x1869755299530240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138055.265282:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:2.0:1783138055.265736:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530752 00000100:00100000:2.0:1783138055.265742:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530752 00000100:00100000:2.0:1783138055.265816:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1783138055.265824:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2350:x1869755299530752:12345-192.168.202.24@tcp:400:kworker.0 00000100:00080000:0.0:1783138055.265908:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783138055.266045:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+6:2350:x1869755299530752:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 48us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138055.266055:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:3.0:1783138055.273974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1783138055.275486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138055.275566:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530368 00000100:00100000:0.0:1783138055.275579:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530368 00000100:00100000:0.0:1783138055.275667:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:0.0:1783138055.275678:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+24:2350:x1869755299530368:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138055.276088:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:723ac79c-2210-42e9-aee9-241993d2ed66+24:2350:x1869755299530368:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 410us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138055.276097:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:1.0:1783138055.279494:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530496 00000100:00100000:1.0:1783138055.279513:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530496 00000100:00100000:0.0:1783138055.279864:0:14843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299531008 00000100:00100000:0.0:1783138055.279870:0:14843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299531008 00000100:00100000:0.0:1783138055.279925:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783138055.279943:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+8:2350:x1869755299530496:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138055.280383:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:723ac79c-2210-42e9-aee9-241993d2ed66+8:2350:x1869755299530496:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 446us (15530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138055.280392:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:0.0:1783138055.280415:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1783138055.280423:0:14843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299531008:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1783138055.280455:0:14843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299531008:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 33us (15435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138055.280461:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00080000:0.0:1783138055.280483:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783138055.289433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138055.289593:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530624 00000100:00100000:1.0:1783138055.289606:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530624 00000100:00100000:1.0:1783138055.289689:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299530880 00000100:00100000:1.0:1783138055.289692:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299530880 00000100:00100000:1.0:1783138055.289723:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1783138055.289734:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299530624:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783138055.289825:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+5:2350:x1869755299530624:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 93us (14348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138055.289832:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1783138055.289865:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1783138055.289871:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299530880:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1783138055.289900:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ec00996-87cf-4d70-a85d-0eb7946f1e6c+5:2350:x1869755299530880:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138055.289906:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00080000:2.0:1783138055.289985:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138055.289991:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783138055.740095:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783138056.600686:0:16382:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1783138056.763796:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138056.891167:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138056.891197:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dffe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322583424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138056.891285:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138056.891519:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583424 00000100:00100000:2.0:1783138056.891529:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583424 00000100:00100000:2.0:1783138056.891621:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138056.891633:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322583424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138056.891695:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783138056.891754:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dd0a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869755322583424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138056.891762:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138056.891815:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dffe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869755322583424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783138056.892018:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783138057.660441:0:14239:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783138057.660454:0:14239:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783138057.660494:0:14239:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783138057.660502:0:14239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783138057.789158:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138057.825455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1783138057.825527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1783138057.825660:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299531264 00000100:00100000:1.0:1783138057.825671:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299531264 00000100:00100000:1.0:1783138057.825741:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1783138057.825752:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+8:2353:x1869755299531264:12345-192.168.202.24@tcp:16:kworker.0 00000100:00100000:1.0:1783138057.825884:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:723ac79c-2210-42e9-aee9-241993d2ed66+8:2353:x1869755299531264:12345-192.168.202.24@tcp:16:kworker.0 Request processed in 135us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.825892:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00080000:1.0:1783138057.825934:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138057.826466:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755299531136 00000100:00100000:3.0:1783138057.826473:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755299531136 00002000:00100000:3.0:1783138057.827363:0:14849:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8e5dffe3b480 x1869755299531136/t0(0) o4->723ac79c-2210-42e9-aee9-241993d2ed66@192.168.202.24@tcp:208/0 lens 504/0 e 0 to 0 dl 1783138068 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783138057.827377:0:14849:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dffe3b480 with x1869755299531136 ext(0->8) 00002000:00010000:3.0:1783138057.827384:0:14849:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e5dffe3b480 00000100:00100000:3.0:1783138057.827456:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1783138057.827467:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:723ac79c-2210-42e9-aee9-241993d2ed66+8:2353:x1869755299531136:12345-192.168.202.24@tcp:4:bash.0 00000100:00100000:3.0:1783138057.828007:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dffe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:723ac79c-2210-42e9-aee9-241993d2ed66+10:2353:x1869755299531136:12345-192.168.202.24@tcp:4:bash.0 Request processed in 541us (2485us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783138057.828025:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00002000:00100000:3.0:1783138057.828033:0:14849:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8e5dffe3b480 x1869755299531136/t8589934598(0) o4->723ac79c-2210-42e9-aee9-241993d2ed66@192.168.202.24@tcp:208/0 lens 504/448 e 0 to 0 dl 1783138068 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783138057.828042:0:14849:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e5dffe3b480 with x1869755299531136 ext(0->8) 00002000:00010000:3.0:1783138057.828045:0:14849:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e5dffe3b480 00000100:00100000:1.0:1783138057.918219:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138057.918251:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322583552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783138057.918375:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.918453:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583552 00000100:00100000:1.0:1783138057.918463:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583552 00000100:00100000:1.0:1783138057.918528:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783138057.918539:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322583552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783138057.918608:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783138057.918658:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5e01408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869755322583552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.918674:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783138057.918697:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783138057.918739:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5e01408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869755322583552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138057.921838:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322583808:0@lo:400:kworker.0 00000100:00100000:0.0:1783138057.921943:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.922085:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322583680:0@lo:400:kworker.0 00000100:00100000:2.0:1783138057.922128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.922178:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322584192:0@lo:400:kworker.0 00000100:00100000:2.0:1783138057.922208:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.922257:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583680 00000100:00100000:2.0:1783138057.922267:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583680 00000100:00100000:2.0:1783138057.922325:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783138057.922336:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3314:x1869755322583680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138057.922395:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe+19:3314:x1869755322583680:12345-0@lo:400:kworker.0 Request processed in 61us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.922403:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783138057.922441:0:16140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322584192 00000100:00100000:2.0:1783138057.922445:0:16140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322584192 00000100:00100000:2.0:1783138057.922484:0:16140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783138057.922490:0:16140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322584192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138057.922523:0:16140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dfb063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869755322584192:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.922529:0:16140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783138057.922717:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5c98b6-fac2-459b-b3cb-96db1ac6b2fe:3314:1869755322583680:0@lo:400:kworker.0 00000100:00100000:2.0:1783138057.922732:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869755322584192:0@lo:400:kworker.0 00000100:00100000:0.0:1783138057.924297:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322584064:0@lo:400:kworker.0 00000100:00100000:0.0:1783138057.924408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.924447:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138057.924454:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e5dc5ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322583936:0@lo:400:kworker.0 00000100:00100000:0.0:1783138057.924479:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.924644:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322584064 00000100:00100000:1.0:1783138057.924653:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322584064 00000100:00100000:1.0:1783138057.924709:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583936 00000100:00100000:1.0:1783138057.924713:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583936 00000100:00100000:1.0:1783138057.924734:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783138057.924743:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322584064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138057.924814:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869755322584064:12345-0@lo:400:kworker.0 Request processed in 71us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.924822:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783138057.924841:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138057.924847:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322583936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138057.924873:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869755322583936:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.924879:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1783138057.924895:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138057.924927:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869755322583936:0@lo:400:kworker.0 00000100:00100000:1.0:1783138057.924939:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869755322584064:0@lo:400:kworker.0 00000100:00100000:3.0:1783138057.930381:0:16139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755322583808 00000100:00100000:3.0:1783138057.930403:0:16139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755322583808 00000100:00100000:3.0:1783138057.930476:0:16139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138057.930488:0:16139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e5dc5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1869755322583808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138057.930632:0:16139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e5dc5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1869755322583808:12345-0@lo:400:kworker.0 Request processed in 146us (8689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.930641:0:16139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138057.930702:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e5dc5ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869755322583808:0@lo:400:kworker.0 00000001:00080000:2.0:1783138057.988689:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1783138057.988734:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1783138057.988754:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1783138057.988768:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed Debug log: 30601 lines, 30601 kept, 0 dropped, 0 bad.